Virtual viewpoint image generation method and system, electronic equipment and storage medium

Abstract

The invention discloses a virtual viewpoint image generation method and system, electronic equipment and a storage medium. The method comprises the steps of obtaining an image combination of a multi-angle free view angle, parameter data of the image combination and preset virtual viewpoint path data; selecting a texture map and a depth map of a corresponding group of each virtual viewpoint in the virtual viewpoint path from the image combination according to the preset virtual viewpoint path data and the parameter data of the image combination; inputting the texture map and the depth map of the corresponding group of each virtual viewpoint into a graphic processor, and for each virtual viewpoint in the virtual viewpoint path, performing combined rendering on the pixel points in the texture map and the depth map of the corresponding group in the selected image combination by using a plurality of threads by taking the pixel points as a processing unit, and obtaining an image corresponding to the virtual viewpoint. According to the scheme, the data processing speed can be increased, and the requirements of low-delay playing and real-time interaction of multi-angle free-view videos are met.

Description

technical field [0001] Embodiments of the present invention relate to the technical field of image processing, and in particular, to a method, system, electronic device, and storage medium for generating a virtual viewpoint image. Background technique [0002] With the continuous development of Internet technology, more and more video platforms continue to improve users' viewing experience by providing higher-definition or watching videos with higher fluency. [0003] However, for videos with a strong sense of on-site experience, such as a video of a sports game, users often can only watch the game through one viewpoint during the viewing process, and cannot freely switch viewpoints to watch the game at different viewpoints. Or the game process, it is impossible to experience the feeling of watching the game while moving the viewpoint on the spot. [0004] 6 Degrees of Freedom (6DoF) technology is a technology to provide a viewing experience with high degrees of freedom. Us...

AI Technical Summary

Problems solved by technology

[0005]However, the current 6DoF video viewing solution requires a large amount of storage and calculation, so a large number of servers need to be deployed on site for processing, resulting in high implementation costs and limited There are too many conditions, and data cannot be processed quickly, so it cannot meet the needs of low-latency playback and real-time interaction of multi-angle free-view video, which is not conducive to popularization

[0006] According to the research of the inventor, the current method of generating virtual viewpoint images is relatively slow, which seriously restricts the demand for low-latency playback and real-time interaction of multi-angle free-view video

Images