Three-dimensional reconstruction method and system for combined optimization of the human body posture and appearance model

Abstract

The invention discloses a three-dimensional reconstruction method and system for combined optimization of the human body posture and the appearance model. The method comprises the following steps of performing depth map photographing on a human body to obtain a single depth image; converting the single depth image into a three-dimensional point cloud, and obtaining the three-dimensional point cloud, rebuilding model vertexes, and parameterizing matching point pairs among the human body model vertexes; according to the matching point pairs, building an energy function, and jointly solving non-rigid motion position transformation parameters and parameterization human body posture model parameters of each vertex on the rebuilt model; solving the energy function, and performing alignment on the rebuilt model and the three-dimensional point cloud according to the obtained result; updating and complementing the aligned model through the depth map to perform real-time human body dynamic three-dimensional rebuilding. The method can effectively improve the rebuilding real-time performance, robustness and accuracy and is high in expandability and simple and easy to implement.

Description

technical field [0001] The invention relates to the technical fields of computer vision and computer graphics, in particular to a three-dimensional reconstruction method and system for jointly optimizing human body posture and appearance models. Background technique [0002] Human dynamic 3D reconstruction is an important issue in the field of computer graphics and computer vision. High-quality dynamic 3D models of human objects, such as human bodies, animals, human faces, and human hands, have broad application prospects and important application values ​​in the fields of film and television entertainment, sports games, and virtual reality. However, the acquisition of high-quality 3D models is usually achieved by expensive laser scanners or multi-camera array systems. Although the accuracy is high, there are also some obvious disadvantages: first, the object is required to remain absolutely still during the scanning process, and the tiny Moving will lead to obvious errors ...

AI Technical Summary

Problems solved by technology

However, the acquisition of high-quality 3D models is usually achieved by expensive laser scanners or multi-camera array systems. Although the accuracy is high, there are also some obvious disadvantages: first, the object is required to remain absolutely still during the scanning process, and the tiny Moving will lead to obvious errors in the scanning results; second, counterfeiting is expensive, and it is difficult to popularize it in the daily life of ordinary people. It is often used in large companies or national statistics departments

Third, the speed is slow. It often takes at least 10 minutes to several hours to rebuild a 3D model, and the cost of rebuilding a dynamic model sequence is even greater.

The second is the reconstruction of human body shape and posture, which is generally parameterized through body shape and posture, and the variables of reconstruction are greatly reduced. The existing technology can reconstruct in real time with a single depth camera, but this type of method cannot obtain a 3D model of the surface appearance of the object

Third, although the frame-by-frame dynamic fusion surface reconstruction method can achieve dynamic 3D reconstruction without templates, it only uses non-rigid surface deformation methods, and the robustness of tracking reconstruction is low.

Images