Multi-viewpoint video encoding and viewpoint synthesis predication method based on least square

Abstract

The invention relates to a multi-viewpoint video encoding and viewpoint synthesis predication method based on least square. The multi-viewpoint video coding and viewpoint synthesis predication method comprises the following steps of: firstly, finding out a corresponding pixel of a current pixel point of a virtual viewpoint frame in a reference viewpoint frame through three-dimensional conversion; then, taking the obtained corresponding pixel in the reference viewpoint frame as a predicated pixel of a current pixel of the virtual viewpoint frame; then, utilizing a previously decoded frame and a virtual viewpoint frame thereof to be trained by least square to obtain a predicated coefficient; then, carrying out linear estimation on a pixel value of the predicated pixel according to the obtained predicated coefficient to obtain the pixel value of the current pixel, and carrying out the same operation on each pixel to finally obtain the virtual viewpoint frame; and finally, adding the generated virtual viewpoint frame into a reference frame list and encoding a frame to be encoded of a current viewpoint by an encoder according to the reference frame list. According to the multi-viewpoint video coding and viewpoint synthesis predication method disclosed by the invention, the quality of a synthesized viewpoint is enhanced by utilizing information in the viewpoints and among the viewpoints at the same time; and the multi-viewpoint video encoding efficiency based on viewpoint synthesis predication is improved.

Description

technical field [0001] The invention relates to a multi-viewpoint video coding viewpoint synthesis prediction method, in particular to a multi-viewpoint video coding viewpoint synthesis prediction method based on least squares. Background technique [0002] The first generation of 3D display terminals is based on the left and right formats, and it only provides two video streams for the left and right eyes respectively. This means that based on this stereoscopic terminal, the viewer is required to wear special glasses and sit in a relatively narrow range to watch. Although the current stereoscopic display system can provide high-quality 3D video, these restrictions on viewing affect the comfort and naturalness of viewing. Recently, advances in depth map research have led to the development of a new 3D display terminal, that is, free-viewpoint television. [0003] The free-viewpoint TV displays different stereoscopic video streams in different directions, which can provide ...

AI Technical Summary

Problems solved by technology

[0005] However, existing VSP techniques only use information between adjacent viewpoints to synthesize virtual viewpoints. Due to the inaccuracy of depth information, the heterogeneity of different cameras, and the non-Lambertian reflection of objects, the quality and predictive ability of virtual viewpoints cannot be improved. is limited

Therefore, the existing VSP technology is difficult to greatly reduce the bit rate, and in the VSP technology, the virtual viewpoint is not used for display, but only for prediction

Images