Multiview Video coding and decoding method and device, and related device

Abstract

The present invention discloses a multiview video coding and decoding method and device, and a related device. The multiview video coding and decoding method comprises the steps of: determining abandoned depth map frames for a depth map sequence in an original multiview video; performing compression coding of texture video frames and non-abandoned depth map frames to obtain texture coding data andnon-abandoned depth map frame coding data; employing the texture coding data and the non-abandoned depth map frame coding data to perform decoding reconstruction to obtain a reconstructed depth map sequence; determining a filtering coefficient according to an original depth map sequence and the reconstructed depth map sequence; and sending the texture coding data, the non-abandoned depth map frame coding data and the filtering coefficient to a decoding terminal. Part of the depth map frames is abandoned, so data requiring coding is reduced, and therefore the coding efficiency of multiview video is improved, and virtual viewpoints and views with high quality are obtained.

Description

technical field The present invention relates to the technical field of video processing, in particular to a multi-viewpoint video encoding and decoding method and device-related equipment. Background technique With the development of digital multimedia processing technology and display technology, people's demand for real visual experience is increasing. After the successful application of high-definition digital TV, three-dimensional TV (Three-Dimensional Television, 3DTV) and Free View Point Television (Free View Point Television, FTV) has quickly become a new research hotspot. Both 3DTV and FTV are typical applications of Three-Dimensional Vision (3DV). 3DV can provide audiences with videos from different viewpoints of the same stereoscopic scene. Compared with two-dimensional videos that cannot provide audiences with natural depth information, 3DV can provide audiences with distance information, thereby bringing audiences the real three-dimensional scene. Visual exper...

AI Technical Summary

Problems solved by technology

Therefore, using MVD to represent a stereoscopic scene and encoding it using traditional multi-view coding standards has reduced the amount of data considerably, but this does not provide cost-effective compression rates for multi-view content, so research on adapting depth The encoding technology of the graph itself is very important

For the research on improving the coding efficiency of the depth map, the existing technology proposes a rate-distortion optimization algorithm based on the view quality of the virtual viewpoint and some not only can effectively code the simple and smooth texture area, but also can effectively protect the sharp edge of the depth map. The depth image encoding and analysis algorithm of the area, but each has its own problems, such as a MVD encoding algorithm for deep temporal downsampling, which can only reduce the depth image information of one view point, and in order to synthesize virtual view video, it also requires the sender Sending additional information such as selection identifiers to the receiving end makes the complexity of the algorithm higher; there are also some algorithms, such as a spatial reconstruction filter and spatial down-sampling and up-sampling methods, which reduce the amount of depth information that needs to be encoded , but each depth frame has to be processed, it still cannot effectively compress the depth map well, and cannot obtain a high-quality virtual viewpoint view