Kinect depth video spatio-temporal union restoration method

Abstract

Provided is a Kinect depth video spatio-temporal union restoration method. According to the Kinect depth video spatio-temporal union restoration method, on the basis of the hypothesis that neighborhood pixels with similar colors should have similar depth values, a color segment image which corresponds to color images is used for guiding depth filling carried out on motion areas extracted from a first depth image and motion areas extracted from all the follow-up depth images; in consideration that some areas with darker colors and without effective depth values can cause failure of the Kinect depth video spatio-temporal union restoration method, the areas with the darker colors are detected firstly, and effective depth values of the same areas with the darker colors are used for repairing empty areas; according to static areas in depth video shot by a Kinect, if a current depth image is provided with empty pixels, filling is carried out by using depth values of positions, corresponding to the positions of the empty pixels, of a previous depth image. Due to the fact that the drawing technology based on the depth images is used for drawing a virtual viewpoint, the image quality of a virtual right view which is correspondingly obtained through the Kinect depth video spatio-temporal union restoration method is obviously better than that of an original virtual right view, and the Kinect depth video spatio-temporal union restoration method can be applied to 3D drawing.

Description

technical field [0001] The invention relates to the technical field of image / video processing and can be applied to 3D rendering. technical background [0002] Three-dimensional stereoscopic TV has been considered by many people to bring a more natural and life-like visual entertainment experience. With the development of stereoscopic display technology and video processing technology, 3D video technology has become a research hotspot in recent years. At present, there are mainly two schemes to realize the stereoscopic video system: one is the multi-view scheme, which acquires the 3D scene by multiple camera arrays and plays it on the stereoscopic display; the other is the "texture + depth" scheme, which uses color texture Video and depth video describe the color texture information and depth information in the stereoscopic scene. Combining the two video information, the depth image based rendering (DIBR) technology is used to draw the virtual viewpoint, and finally the syn...

AI Technical Summary

Problems solved by technology

This method can effectively reduce optical noise and repair boundaries, but it does not consider the depth repair of reflective and dark areas, and the effect of this method is affected by the accuracy of motion estimation.

Images