A method of converting 2d video to 3d video

Abstract

A method for converting 2D video into 3D video belongs to the field of pattern recognition and computer vision, and aims to eliminate unpredictable errors caused by scene depth estimation and viewpoint synthesis in the prior art, while greatly improving calculation speed. The present invention includes a training stage and a use stage, the training stage sequentially includes the steps of data input, feature extraction, feature fusion, viewpoint synthesis and parameter update; the use stage sequentially includes the steps of data input, feature extraction, feature fusion and viewpoint synthesis. In the training phase, the 3D stereoscopic video films with 106 levels of left and right formats are trained, and the scene depth estimation and viewpoint synthesis are optimized and solved at the same time. The 3D video is divided into two task operations to cause errors; after the training is completed, the conversion from 2D video to 3D video can be directly performed, which can greatly improve the conversion efficiency and ensure the accuracy of the final output 3D stereoscopic video.

Description

technical field [0001] The invention belongs to the field of pattern recognition and computer vision, and in particular relates to a method for converting 2D video into 3D video, which is used to directly convert the plane 2D video captured by a common camera into a left-right 3D stereoscopic video that can be viewed in a cinema. Background technique [0002] With the development of virtual reality technology, immersing the audience in 3D experience has become a very important direction in the field of multimedia entertainment. The 3D experience needs the support of panoramic video and 3D effect. If you want to get the 3D viewing experience of the theater for ordinary flat video, you need to convert the 2D flat video into 3D video. There are many formats of 3D video. For 3D stereoscopic video with left and right formats, usually 2D video is converted to 3D video by first estimating the objects in the 2D video image based on various geometric relationships in the 2D video ima...

AI Technical Summary

Problems solved by technology

On the one hand, these solutions consume a lot of computing resources, and the time cost is relatively high; on the other hand, the depth extraction of the scene and the viewpoint synthesis technology are still being further explored, and there will be large calculation errors in the actual use process. Two parts The error is easy to accumulate and affect the final viewing experience

With the advent of the era of big data, more and more high-quality 3D movies, documentaries, animations and other videos have been produced, but the post-2D to 3D production of current flat videos still consumes huge manpower and material resources

Images