Three-dimensional reconstruction method and device based on speckle stripe hybrid modulation

Abstract

Based on the binocular stereoscopic vision principle, the three-dimensional reconstruction method and device based on speckle and stripe hybrid modulation are researched, the device collects N frames of speckles and M frames of phase shift stripe images (N > = 1, M > = 3), and then high-precision three-dimensional face reconstruction can be achieved. The method comprises the following steps: firstly, carrying out stereo matching by using a speckle image to obtain a coarse disparity map, then obtaining two groups of truncated phases through a phase shift fringe image, and carrying out single linear interpolation on coarse disparity by adopting an interleaving modulation method to obtain a fine disparity map so as to finish three-dimensional reconstruction. Compared with a traditional method, the method has the advantages that the problem of wrong matching caused by the fact that a matching point appears near a truncation phase period boundary is solved by the aid of a staggered modulation method, sensitivity of a dynamic scene is low, and an effective solution is provided for real-time high-precision three-dimensional face measurement.

Description

technical field [0001] The invention relates to the field of optical three-dimensional imaging, in particular to a three-dimensional reconstruction method and equipment based on speckle and fringe hybrid modulation. Background technique [0002] In the field of 3D reconstruction, many methods have been proposed, which can be divided into active and passive measurement methods according to whether structured light is used in the measurement process. Among them, the passive method does not need to project additional structured light information, but reconstructs the three-dimensional data from the texture of the measured object through triangulation and complex and time-consuming stereo matching algorithm to measure the angle of accuracy; the active measurement method is active projection Additional information is encoded on the surface of the measured object, which can improve the spatial resolution of the 3D reconstruction. Compared with the passive method, the active measu...

AI Technical Summary

Problems solved by technology

[0012] Aiming at the specific problems in the background technology of capturing high-precision real-time 3D point cloud data in a dynamic environment, the robustness of the algorithm and poor engineering applicability, a phase-free unfolding 3D human face based on the spatial distribution of human face shape is provided. The face reconstruction method and system realizes high-precision real-time 3D point cloud reconstruction through the interleaved modulation algorithm, and can complete high-precision 3D reconstruction without phase unwrapping

Images