Three-dimensional reconstruction method based on light field information and system

Abstract

The invention is applicable to the computer vision technology field and provides a three-dimensional reconstruction method based on the light field information and a system. The method comprises steps that a light field camera is utilized to shoot a to-be-reconstructed scene to acquire the four-dimensional light field information; frequency domain digital refocusing processing on the acquired four-dimensional light field information is carried out to acquire an N-refocusing-picture sequence; secondary wavelet transformation for the N-refocusing-picture sequence is carried out, and characteristic extraction of a secondary wavelet transformation result is further carried out; the extracted characteristics are taken as input, and an SVM regression model is employed to carry out regression processing on partial focusing quality to acquire focusing quality evaluation of each pixel; the focusing quality evaluation is converted into likelihood depth maps; an image segmentation algorithm is utilized to carry out color clustering analysis on an original image, random field nodes are extracted, modeling for the color-based random field nodes is carried out, iteration processing on the likelihood depth maps is carried out to acquire a final scene depth map, and three-dimensional reconstruction for the scene is realized.

Description

technical field [0001] The invention belongs to the technical field of computer vision, in particular to a three-dimensional reconstruction method and system based on light field information. Background technique [0002] Light field imaging technology is an imaging method that can obtain light position and direction information at the same time, and use the related algorithm of signal processing to process the light field information. Different from the traditional imaging system which can only obtain the position information of the optical radiation, the light field imaging system can record the four-dimensional position and direction information of the optical radiation during the propagation process, thus obtaining relatively more image information, which provides information for related applications of image processing. Broader development ideas and directions. At the same time, with the continuous development of three-dimensional display technology, more and more obje...

AI Technical Summary

Problems solved by technology

The first method requires a long cycle and complicated operation, which requires high requirements for operators, and the reconstruction effect is not ideal; the second method has a good reconstruction effect, but the 3D scanning equipment is expensive and the reconstruction cost is relatively high

Images