Beautifying method and system for virtual scene live

Abstract

The invention relates to the field of multimedia data processing, and discloses a beautifying method and system for virtual scene live. The method comprising the steps that the data of a camera device are acquired in real time to acquire first image data; the first image data are converted into a texture image, and the texture image is updated to a virtual scene; a first object is extracted from the virtual scene through a GPU; and the first object is beautified and the virtual scene is rendered to acquire a render image. According to the technical scheme, the data of the camera device are converted into the texture image; the texture image is updated to the virtual scene; at the rendering stage of the virtual scene, the first object is extracted through the GPU; the first object is beautified to acquire the render image; rendering and beautifying are carried out in parallel; and the delay time of beautifying in virtual scene live is greatly reduced.

Description

technical field [0001] The invention relates to the field of multimedia data processing, in particular to a technology for processing live data of a virtual scene. Background technique [0002] Due to the decline of equipment costs and the maturity of live broadcast technology, the entertainment form of live performance through the Internet is gradually accepted and welcomed by the public. The virtual scene synthesis technology is a multimedia data processing technology applied to recording and broadcasting programs in TV studios or film production, such as weather forecast programs, etc. [0003] In the prior art, the virtual scene synthesis technology usually extracts the portraits in the solid-color background collected by the camera device, and then superimposes and synthesizes them with the rendered virtual scene background, and then outputs the synthesized image data for playback or recording storage. [0004] The existing virtual scene technology cannot realize high...

AI Technical Summary

Problems solved by technology

However, the existing beauty processing is to perform processing operations on each pixel in the image. The amount of data processing operations is large, has a high delay, and takes up a lot of CPU resources, and cannot be applied to live broadcasts that require high real-time performance.

In addition, in some existing live broadcast data processing solutions, the video stream is directly processed for beautification, which invisibly increases the delay of the live broadcast

Images