A virtual and real lighting fusion method for video scenes

Abstract

The invention discloses a method for integrating virtual light and real light of a video scene. The method comprises the following steps of: extracting video key frames from videos according to equal time intervals, establishing each clue by using the sky, the ground, and a vertical surface in images of the video key frames as clues respectively, then calculating and deducing to obtain a probability distribution map of the sun position, deducing to obtain the possibility distribution map of the sun position in the scene of the video key frames by using the sub position possibility obtained according to the video sky, the ground and the vertical surface, and generating a sparse radiancy map of the video scene key frames; and correcting an illumination estimation result of video non-key frames by an illumination parameter filtering algorithm by using the illumination estimation result of the video key frames, and integrating the virtual light and the real light of the video scene. By the method, the lighting effect of generating the virtual and real light integration video is effectively smoothed.

Description

technical field [0001] The invention relates to image processing and augmented reality technology, in particular to a virtual and real light fusion method of a video scene. Background technique [0002] Virtual reality is a research field that has been developing continuously in recent years. Through high-tech with computer science and technology as the core, a realistic virtual environment that is highly similar to the real environment in terms of sight, hearing, and touch is generated, so that users can get immersive experience in the virtual environment. Feelings and experiences of the environment. Traditional virtual reality technology mainly emphasizes virtual scene modeling and virtual scene performance, and seldom directly integrates the virtual environment into the objective real world, which affects the development and application of virtual reality technology to a certain extent. Augmented reality is a further extension of virtual reality. With the help of necessa...

AI Technical Summary

Problems solved by technology

Furthermore, from the perspective of video processing, most of the existing technologies ignore the correlation between video frames. When performing illumination estimation frame by frame, there are inevitably differences in the estimated information of a single frame, resulting in the generation of virtual images in the video scene. The discontinuity of the light and shadow effects of objects, that is, there are differences in the consistency of virtual and real lighting and virtual and real shadows between adjacent frames in the video

Images