Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A method for 3D face reconstruction from any viewing angle based on adaptive deformation model

A deformation model and three-dimensional reconstruction technology, applied in the field of face three-dimensional reconstruction from any viewing angle, can solve the problem that the three-dimensional face reconstruction method is difficult to meet the needs, it is difficult to meet the three-dimensional reconstruction of the face from any viewing angle, and the viewing angle changes greatly, etc. question

Active Publication Date: 2017-01-11
TSINGHUA UNIV
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, in the environment of video surveillance, face images are acquired without the target being conscious, and there may be situations where the viewing angle changes greatly. Therefore, it is difficult for existing research to meet the requirements of 3D face reconstruction from any viewing angle.
[0005] Based on the above analysis, 3D face reconstruction from any angle is an important technology and research hotspot in the field of intelligent security, and the existing 3D face reconstruction methods are difficult to meet the needs

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method for 3D face reconstruction from any viewing angle based on adaptive deformation model
  • A method for 3D face reconstruction from any viewing angle based on adaptive deformation model
  • A method for 3D face reconstruction from any viewing angle based on adaptive deformation model

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0096] Embodiment: Using the 3D reconstruction results of the face images of 6 people captured by the AXIS1011W network camera, and inputting the face images from different perspectives, the 3D reconstruction method of the face from any perspective based on the adaptive deformation model of the present invention can be reconstructed to obtain the human face The 3D model is projected to images of 0°, ±45° and ±60° viewing angles.

[0097] In order to quantitatively analyze the effect of reconstruction, the average point-to-point error of the feature points in the frontal projection image of the reconstructed 3D model of the face and the feature points of the real face frontal image captured by the CCD sensor can be directly compared, as well as the average closest point-to-line distance .

[0098] The average point-to-point error is defined as:

[0099] D pt · pt = 1 N ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a method for carrying out face three-dimensional reconstruction at any viewing angle on the basis of a self-adaptive deformable model. The method includes the steps of (1) obtaining face image data and screening a face image with high definition as original data, (2) positioning feature points, (3) coarsely estimating the angle of a face according to the positioning result of the feature points, (4) building a face three-dimensional deformable model, adjusting the feature points of the face to be at the same dimension as the face three-dimensional deformable model through translation and scaling and extracting coordinate information of the points corresponding to the feature points of the face to form a sparse face three-dimensional deformable model, (5) iterating face three-dimensional reconstruction by means of the particle swarm optimization algorithm according to the coarsely estimation value of the angle of the face and the sparse face three-dimensional deformable model to obtain a face three-dimensional geometric model, (6)mapping input face texture information in a two-dimensional image to the face three-dimensional geometric model in a texture pasting method after the face three-dimensional geometric model is obtained, so that a complete face three-dimensional model is obtained. The method can be widely used in the field of identity identification.

Description

technical field [0001] The invention relates to computer vision and computer graphics, in particular to a method for three-dimensional reconstruction of a human face at any viewing angle based on an adaptive deformation model. Background technique [0002] The large-scale coverage video surveillance system widely used in public security, intelligent security and other fields has put forward new requirements for pedestrian identification technology based on surveillance images. In recent years, in many vicious criminal cases in public areas, the face images of criminal suspects are obtained through video surveillance systems. , Reducing economic losses and reducing social adverse effects are of great significance. [0003] The current common multi-view face recognition technology can be divided into knowledge-based methods and statistical learning-based methods. The knowledge-based method uses local features of the face, such as eyes, nose, eyebrows, lips, and chin, etc., a...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06T17/00
Inventor 王雪林奎成
Owner TSINGHUA UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products