Two-dimensional video and three-dimensional scene fusion method and device, equipment and storage medium

Abstract

The invention relates to a two-dimensional video and three-dimensional scene fusion method and device, equipment and a storage medium. The method comprises the steps of obtaining depth texture information and pixel values of a to-be-fused scene; obtaining world coordinates according to the depth texture information and the pixel viewport coordinates; obtaining to-be-fused pixel points by using a shadow volume algorithm according to the specified projection mode of the to-be-fused video, wherein the specified projection mode is generated according to user settings; calculating texture coordinates of the to-be-fused video corresponding to the to-be-fused pixel points according to the world coordinates; and fusing the to-be-fused video and the to-be-fused scene by taking the texture coordinates and the viewport coordinates as standards and combining the pixel values. According to the method, the coordinates of the three-dimensional scene are calculated by adopting the depth texture, and the projection of the video to the scene is realized by virtue of the shadow volume algorithm, so that seamless fusion of the video and the scene is realized.

Description

technical field [0001] The present invention relates to the technical field of video scene fusion, in particular to a fusion method, device, equipment and storage medium of two-dimensional video and three-dimensional scene. Background technique [0002] With the development of software technology, the display technology of 3D scenes is also becoming more and more sophisticated. The display of the 3D scene can be applied in many fields. The 3D scene display will involve the fusion of scenes and videos, such as the fusion of 3D scenes and videos in game scenes, or the fusion of scenes and videos in the monitoring field. Obviously, the fusion effect of 3D scene and video directly affects the display effect and user experience. [0003] Existing scene and video fusion technologies mostly use videos to directly paste models or vertically project videos. Usually, only the center area of ​​the videos projected by these methods can be approximated in a 3D scene. The video in the ...

AI Technical Summary

Problems solved by technology

[0003] Existing scene and video fusion technologies mostly use videos to directly paste models or vertically project videos. Usually, only the center area of ​​the videos projected by these methods can be approximated in a 3D scene. There is a large deviation between the video in the surrounding area and the scene, which will cause the projected video to appear distorted

Images