Three-dimensional reconstruction method and system

Abstract

The invention provides a three-dimensional reconstruction method and system. The method comprises: performing a stereo matching process and an error matching process based on phase-only correlation on obtained images in various resolutions; and obtaining a three-dimensional coordinate of each point according to stereo matching results and pre-stored internal and external parameters of a binocular camera and after each three-dimensional coordinate is processed and colored, a three-dimensional model is obtained and output. According to the invention, the obtained images are subjected to the pretreatment and the stereo matching in various resolutions, so that the relations among the various resolutions are made full use of, judgment and correction of the error matching can be guaranteed to be more reasonable, the three-dimensional model output finally is more effective, effective three-dimensional model can still be output even though the image quality of obtained images is low, and the effect of a three-dimensional reconstruction is improved.

Description

technical field [0001] The invention relates to the field of image processing, in particular to a three-dimensional reconstruction method and system. Background technique [0002] A 3D model is a 3D polygonal representation of an object, usually displayed on a computer or other video device. With the development of 3D technology, 3D models are gradually applied to medicine, film, industry, and games, playing an extremely important role in modern technology. As an effective means to obtain 3D information, 3D reconstruction has become a research hotspot in the fields of computer graphics and computer vision. The main technologies for obtaining 3D information can be divided into two types: active and passive: active technologies require laser scanning to obtain depth maps or medical imaging equipment, such as CT, MRT, PET, etc., to obtain slice data sequences of faults. The data is accurate, but it is too expensive to be widely used; and the passive technology based on stereo...

AI Technical Summary

Problems solved by technology

Although this method has certain theoretical significance and rationality, and obtained better results under the author's experimental conditions, however, because the phase correlation is more sensitive to texture, once the quality of the picture is not high enough, there will be a mismatch , therefore, when the image quality is low, the effect of 3D reconstruction based on phase correlation will be greatly reduced

In addition, these methods did not consider the connection between different resolutions in the multi-resolution matching process, and at the same time, they failed to limit the depth range of the output of the 3D model, which affected the effect of the 3D model

[0011] Currently subject to the limitations of stereo matching algorithms, 3D reconstruction based on binocular vision cannot be applied to mobile terminals such as mobile phones. On the one hand, the current stereo matching algorithm requires a certain distance between the two cameras, which limits the hardware design of mobile phones; On the other hand, the poor shooting quality of the built-in camera of the mobile terminal will seriously affect the accuracy of stereo matching, thereby affecting the effect of 3D reconstruction.

Therefore, there is currently no related technology for 3D reconstruction on mobile terminals, which cannot meet people's needs for storing 3D information.

Images