Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Three-dimensional facial reconstruction method

A three-dimensional face and three-dimensional technology, which is applied in the field of image-based three-dimensional face reconstruction, can solve the problems of large amount of calculation and cannot be fully automated, and achieve the effect of robust reconstruction process, shortened geometric reconstruction speed and strong sense of reality.

Inactive Publication Date: 2010-06-23
INST OF AUTOMATION CHINESE ACAD OF SCI +1
View PDF0 Cites 58 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This method can obtain realistic reconstruction results, but the disadvantage is that it is computationally intensive and cannot be fully automated

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Three-dimensional facial reconstruction method
  • Three-dimensional facial reconstruction method
  • Three-dimensional facial reconstruction method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0046] Embodiment one, with reference to figure 1 , establish a face deformation model offline, input a single frontal face image, and obtain the reconstruction result after face detection, face key point positioning, face geometric reconstruction, face texture fitting and other steps, the specific implementation process is as follows:

[0047] 1. Establishment of face deformation model

[0048] Use a 3D scanner to collect a real 3D face model and perform regularization processing, and perform principal component analysis on the shape and texture of the regularized face model to obtain a deformed face model, including shape components and texture components; the reconstructed 3D face model The shape and texture of the face model can be expressed as:

[0049] S = S 0 + Σ k = 1 M α k S ...

Embodiment 2

[0086] Embodiment two, refer to figure 2 The steps of the establishment of the deformation model, face detection, key point location and face geometric reconstruction are the same as those in the first embodiment. After the geometry of the three-dimensional face is obtained, the face texture fitting is not performed, but the input image is used as texture. The implementation steps of this embodiment are as follows:

[0087] Step 1. Use a 3D scanner to collect a real 3D face model and perform regularization processing. Perform principal component analysis on the shape and texture of the regularized face model to obtain a face deformation model, including two parts: shape component and texture component ;

[0088] Step 2. Use Adaboost to automatically detect the face position in the input image;

[0089] Step 3. Utilize the active appearance model to automatically locate the key points on the human face in the input image;

[0090] Step 4. Restore the shape parameters and a...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a three-dimensional facial reconstruction method, which can automatically reconstruct a three-dimensional facial model from a single front face image and puts forward two schemes. The first scheme is as follows: a deformable face model is generated off line; Adaboost is utilized to automatically detect face positions in the inputted image; an active appearance model is utilized to automatically locate key points on the face in the inputted image; based on the shape components of the deformable face model and the key points of the face on the image, the geometry of a three-dimensional face is reconstructed; with a shape-free texture as a target image, the texture components of the deformable face model are utilized to fit face textures, so that a whole face texture is obtained; and after texture mapping, a reconstructed result is obtained. The second scheme has the following differences from the first scheme: after the geometry of the three-dimensional face is reconstructed, face texture fitting is not carried out, but the inputted image is directly used as a texture image as a reconstructed result. The first scheme is applicable to fields such as film and television making and three-dimensional face recognition, and the reconstruction speed of the second scheme is high.

Description

technical field [0001] The invention relates to the fields of graphic image processing and computer vision, in particular to an image-based three-dimensional human face reconstruction method. Background technique [0002] Image-based 3D face reconstruction refers to the establishment of a personalized 3D face model in a computer starting from a 2D face image. It is a research hotspot and difficulty in the fields of computer graphics, computer vision, etc., and has attracted a large number of scientific researches. In addition, it has broad application prospects, mainly including: 3D games, film and television production, human-computer interaction interface, telepresence, biometric identification, medical treatment, education, etc. According to different forms of input data, image-based 3D face reconstruction methods can be divided into face reconstruction based on a single image, based on two images, based on multiple images, and based on video. Which method to use is mainl...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06T15/00G06T17/00
Inventor 王阳生丁宾姚健杜志军杨明浩
Owner INST OF AUTOMATION CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com