Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A method and system for 3D face reconstruction based on edge graph

A 3D face and 3D reconstruction technology, which is applied in the field of 3D face modeling, can solve the problems of high calibration accuracy of target feature points, points that cannot be reconstructed with pose changes, and poor adaptability of face poses, etc., to overcome the inability to reconstruct Faces with arbitrary poses, the problem of sensitive calibration feature points are improved, and the effect of avoiding reconstruction errors

Active Publication Date: 2017-11-24
NANJING UNIV OF AERONAUTICS & ASTRONAUTICS
View PDF2 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the sparse deformable model has two main shortcomings. One is that it has poor adaptability to face poses and cannot reconstruct points with pose changes. The other is that it requires high calibration accuracy of target feature points, and Point calibration directly affects the reconstruction accuracy of the algorithm

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method and system for 3D face reconstruction based on edge graph
  • A method and system for 3D face reconstruction based on edge graph
  • A method and system for 3D face reconstruction based on edge graph

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0037] The present invention mainly relates to the three-dimensional reconstruction technology of a single face photo and the optimization technology of genetic algorithm, and the specific technical scheme is as follows:

[0038] (1) Initialize the algorithm, including the standardization of the 3D face sample library and the calibration of the feature points of the input 2D image, etc.;

[0039] (2) Carry out the following reconstruction algorithm:

[0040] ① Generate a two-dimensional face edge line according to the face feature points of the two-dimensional image;

[0041] ②Create a 3D face edge map based on the normalized 3D face sample library;

[0042]③According to the normalized 3D face sample library, the average model is obtained;

[0043] ④ Match the edge line and edge map of the target image by genetic algorithm, and optimize to obtain the target 3D reconstruction coefficient sequence.

[0044] (3) Obtaining the final reconstructed face 3D shape model.

[0045] ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a three-dimensional human face reestablishment method and system based on an edge graph. The method comprises the steps that first, according to human face feature points of a two-dimensional graph, a two-dimensional human face edge line is generated; second, according to a three-dimensional human face sample base obtained after standardization, a three-dimensional human face edge graph is established, and meanwhile the three-dimensional human face sample base obtained after standardization is subjected to main component decomposing to obtain feature vectors; third, through a genetic algorithm, the two-dimensional human face edge line of a target image and the three-dimensional human face edge graph are matched, optimization is carried out, and a three-dimensional reestablishing coefficient sequence of the target image is obtained; and fourth, the feature vectors in the second step and the three-dimensional reestablishing coefficient sequence in the third step are synthesized to reestablish a three-dimensional human face model. The problem of human face posture changing is solved, errors caused on reestablishing from feature point calibration are greatly reduced, and the problem that a sparse deforming model is sensitive to the feature points is well solved.

Description

technical field [0001] The invention relates to the fields of computer graphics, digital image processing, artificial intelligence, etc., in particular to a method and system for three-dimensional human face modeling through plane images. Background technique [0002] There are many classic methods for face reconstruction. For example, the method of deformation model reconstruction has been a research hotspot in recent years. It uses the idea of ​​linear combination to decompose existing samples into feature subspaces, and use the basis in the feature subspace to represent specific instances. . However, since the deformation model seeks the global optimal solution through an iterative method, the optimization process is extremely time-consuming through iterative optimization of the three-dimensional model. In addition, the sparse deformation model method restores the depth information of the face by approximating the deformation parameters based on a small number of facial ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06T17/00G06T15/00
CPCG06T17/00
Inventor 周大可曹元鹏方三勇
Owner NANJING UNIV OF AERONAUTICS & ASTRONAUTICS
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products