Real-time virtual scene LED shooting system and method

Abstract

The invention discloses a real-time virtual scene LED shooting system and method, and belongs to the field of movie and television shooting. According to the invention, the digital assets are called to construct the virtual scene according to the content needing to be presented by shooting scenes, the virtual LED screen and the virtual camera are reconstructed in a virtual engine module, and the real environment illumination information in the photostudio is synchronized to the virtual engine in real time. Distributed real-time rendering is performed on the virtual scene through the virtual engine module and the virtual scene is displayed on a virtual LED screen; the virtual engine further overlaps a picture with a depth channel rendered by the virtual engine in real time according to theposition of the real-time camera and lens distortion information outside the virtual LED screen. The physical LED screen displays the virtual LED screen, the real-time camera completes shooting, the XR module obtains the picture with the depth channel and the picture shot by the real-time camera, and a final picture is obtained through synthesis. The method can replace green screen key to achievethe effect of direct film formation in most environments, optimize the film production process, and save the cost of complex visual special effects.

Description

technical field [0001] The invention belongs to the field of film and television drama shooting, and in particular relates to a real-time virtual scene LED shooting system and method. Background technique [0002] At present, the production process of many film and television dramas is extremely complicated, and the production schedule is highly compact, and there are many uncertain links. This process is often linear, challenging and costly with uneven distribution of resources in the process of continuously improving to achieve the desired outcome. During the on-site shooting, due to visual fragmentation, all the professional knowledge related to film and television drama production of the main creators may not be fully utilized. [0003] In the traditional green screen virtual shooting process, the digital assets produced by artists neither have the best image quality nor real-time plasticity. Costly. The existing virtual shooting technology has the disadvantages of po...

AI Technical Summary

Problems solved by technology

[0002] At present, the production process of many film and television dramas is extremely complicated, and the production schedule is highly compact, and there are many uncertain links

The process is often linear, challenging and costly with uneven distribution of resources in the process of continuously improving to achieve the desired outcome

During the on-site shooting, due to visual fragmentation, all the professional knowledge related to film and television drama production of the creators may not be fully utilized

[0003] In the traditional green screen virtual shooting process, the digital assets produced by artists neither have the best image quality nor real-time plasticity. high cost

The existing virtual shooting technology has the disadvantages of poor green screen keying effect, mismatched lighting, and high picture delay

Images