Intermediate view synthesizing method based on block matching disparity estimation

Abstract

The invention discloses an intermediate view synthesizing method based on block matching disparity estimation. In order to carry out disparity estimation on two images selected from the same scene, the same time and different angles, a virtual view at any position on a straight line (baseline) between original views is obtained through image interpolation according to the acquired disparity image. The method comprises the following steps: firstly carrying out disparity estimation by taking a left view and a right view as target images respectively, and computing two disparity views from the left view to the right view as well as from the right view to the left view by adopting a disparity estimation algorithm based on the block matching; then synthesizing a preliminary intermediate view according to the disparity views; and finally carrying out hole filling on the synthetic view to obtain a final result. Aiming at the characteristic that the left view and the right view only have parallax in the horizontal direction because shooting is carried out by a camera on a horizontal line, search is only carried out in the horizontal direction, the amount of calculation is reduced, and thealgorithm running time is shortened; and the experimental result indicates that a favorable synthetic result can be obtained under the condition of a farther distance of view foreground to the cameraor smooth image gradation changes.

Description

technical field [0001] The invention relates to a processing method of a binocular digital image, in particular to a method for synthesizing intermediate viewpoints of a binocular digital image. Background technique [0002] With the continuous development of multimedia technology, image and video technology is also developing from two-dimensional to three-dimensional, and interactivity will become a main feature of future multimedia technology. One of the key technologies of interactive 3D video system is virtual view synthesis technology. Virtual viewpoint rendering synthesis is an indispensable module for all stereoscopic display system terminals, and it also plays a vital role in high-end multimedia fields such as remote video conferencing and free viewpoint stereoscopic TV. In order to enable users to roam in the scene and realize "continuous look around", the number of cameras should be as many as possible during the multi-view video collection process, but due to the...

AI Technical Summary

Problems solved by technology

Doing so can correct a part of the wrongly matched disparity, and achieve the purpose of smoothing the disparity field to a certain extent, but it will cause another part of the original correct disparity to be given a wrong disparity value. Moreover, the increase of the image segmentation module makes the whole algorithm The amount of calculation increases

Images