Depth video encoding method based on edges and oriented toward virtual visual rendering

Abstract

The invention discloses a depth video encoding method based on edges and oriented toward virtual visual rendering. The method comprises the steps that (1) the edges are detected, macro blocks of a depth map are processed through a Sobel edge detection algorithm, and edge values of the macro blocks of the depth map are detected out; (2) the types of the macro blocks of the depth map are classified, a threshold value lambda used for classifying the macro blocks is set, the edge values of the macro blocks of the depth map are compared with the set threshold value lambda, and the macro blocks are classified into edge areas and flat areas; (3) the macro blocks of the depth map are encoded to obtain encoded macro blocks of the depth map, and different encoding forecasting modes are adopted; (4) mid-value mean shift filtering is carried out, a mean shift filter is used for removing a block effect of the encoded macro blocks of the depth map in the edge areas, and the edges are protected. The algorithm improves the compression speed of the depth map and the encoding quality of the depth map of the virtual vision on the premise that the subjective quality of virtual vision videos is basically not changed.

Description

technical field [0001] The present invention relates to a depth video encoding method, in particular to an edge-based depth video encoding method oriented to virtual view rendering. Background technique [0002] 3D video can provide the audience with a three-dimensional depth of visual effects, enhance the sense of visual reality and lifelike. There is an existing depth-based multi-view stereo system, which first uses a depth estimation algorithm to obtain depth information from two channels of color video; then encodes and transmits one or more channels of color video and depth information; finally, at the decoding end , using DepthImageBasedRendering (DIBR) technology to synthesize 8 viewpoints. Therefore, compared with the color video multi-view stereo system, the depth-based multi-view stereo system can significantly reduce the amount of transmitted data, and can realize real-time transmission within a limited bandwidth. [0003] A depth video is composed of a frame-by...

AI Technical Summary

Problems solved by technology

This method makes full use of the sharp transition between the edge and the smooth area in the depth map, thereby improving the coding efficiency of the depth map while ensuring the quality of virtual vision, but the improvement of the coding efficiency is limited.

Images