A high-fidelity face 3D reconstruction method based on multi-layer deformation model

Abstract

The invention discloses a high-fidelity face three-dimensional reconstruction method based on a multilevel deformation model. According to the method, a video image sequence is used as input data, camera parameters and camera loci are restored through detection and tracking of light stream feature points, extraction and matching of face feature points as well as camera calibration by utilizing a movement restoration structure technology, a face multilevel deformation model is proposed, and then a high-fidelity face three-dimensional model of a target face is obtained by texture mapping. According to the method, the face multilevel deformation model is proposed by combining the deformation model technology with the movement restoration structure technology, so that the reconstruction result highly similar to the target face can be achieved; meanwhile, the defect of surface noise appearing in the traditional movement restoration structure is overcome, and face details can be provided by utilizing the movement restoration structure; and the high-fidelity face model obtained by the reconstruction method is widely applied in the fields of face recognition, personalized customized games, virtual reality, security department and the like.

Description

technical field [0001] The invention belongs to the field of computer vision, and in particular relates to a high-fidelity human face three-dimensional reconstruction method based on a multi-layer deformation model. Background technique [0002] 3D reconstruction is the field of computer vision, computer graphics and computer graphics, and it is also an important intersection point of graphics and imaging. The 3D reconstruction of human faces is especially important in face recognition, personalized games, virtual reality and security departments. and other fields have a wide range of applications. However, the human face is unique and variable, which brings challenges to the research of face reconstruction. [0003] The problem that urgently needs a breakthrough in 3D face reconstruction is how to increase the calculation speed and reduce the reconstruction error. Because compared with the 3D reconstruction based on ordinary RGB image sequences, the speed and accuracy bas...

AI Technical Summary

Problems solved by technology

[0008] The present invention proposes a high-fidelity human face three-dimensional reconstruction method based on a multi-layer deformation model, which overcomes the current limitations of the above two three-dimensional reconstruction technologies, such as the disadvantages of tending to the average face and unreal texture based on the human face deformation model. Based on the shortcomings of the motion restoration structure method, such as surface noise holes, etc., the target face video is used as the basic data content, and the 3D face database is processed as a preparation. Further, a multi-layer deformation model of the face is proposed. Global deformation and local deformation are performed on the feature level and detail level to construct a 3D model of the target face with high similarity, smooth surface and realistic effect, so it is especially suitable for face recognition, personalized customized games, virtual reality and security department archives and other application scenarios

Images