Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Three-dimensional face reconstruction method and system

A technology of 3D face and target face, applied in 3D modeling, image data processing, 3D image processing, etc., can solve problems such as lack of authenticity, achieve the effect of improving texture details and improving accuracy

Active Publication Date: 2019-10-22
新拓三维技术(深圳)有限公司
View PDF10 Cites 45 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] However, in the existing technology, face templates are established through machine learning, which lacks authenticity

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Three-dimensional face reconstruction method and system
  • Three-dimensional face reconstruction method and system
  • Three-dimensional face reconstruction method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0037] Such as figure 1 As shown, the present invention provides a kind of three-dimensional human face reconstruction method, comprises the steps:

[0038] S1: Obtain color images and depth images of the target face from at least two viewing angles, and determine whether the color images and the depth images are aligned;

[0039] S2: In the case that the color image and the depth image are aligned, extract the two-dimensional coordinates of the marker points of the target face in the color image through deep learning, and according to the color image and the depth image The corresponding relationship obtains the three-dimensional coordinates of the marker points of the target face;

[0040] S3: Estimate the position of the target face according to the three-dimensional coordinates of the landmark points of the target face and set a threshold value of the depth value, so as to filter out the target face from the original target face three-dimensional point cloud model of the ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a three-dimensional face reconstruction method and system, and the method comprises the steps: obtaining a color image and a depth image of a target face under at least two visual angles, and judging whether the color image and the depth image are aligned or not; acquiring three-dimensional coordinates of the mark points of the target face and an original target face three-dimensional point cloud model of the target face; screening out a point cloud model of the target face; carrying out point cloud rough matching to obtain a roughly registered target face three-dimensional point cloud model; performing accurate registration to obtain an accurately registered target face three-dimensional point cloud model; fusion deduplication, gridding and grid fairing are carriedout, and then performing texture enhancement to obtain an optimized target face grid model; and making a texture map, and performing texture mapping on the optimized target face grid model to obtain afinal target face grid model. And the reconstructed face model is higher in quality and is closer to a real face effect.

Description

technical field [0001] The invention relates to the technical field of image processing, in particular to a three-dimensional face reconstruction method and system. Background technique [0002] With the rapid development and popularization of depth cameras, the 3D data of objects can be obtained more and more quickly and accurately, which makes depth cameras rapidly applied in fields such as 3D space mapping, 3D reconstruction of objects, intelligent human-computer interaction, and VR. Reconstructing a 3D face model based on face depth data is a hot topic in current research. [0003] However, in the prior art, face templates are established through machine learning, which lacks authenticity. Contents of the invention [0004] In order to solve the problems in the prior art, the present invention provides a three-dimensional face reconstruction method and system. [0005] The technical scheme that the present invention adopts is as follows: [0006] A three-dimensional...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06T17/20G06T15/04G06T7/33
CPCG06T17/20G06T15/04G06T7/33G06T2207/10024G06T2207/10028G06T2207/30201G06T2207/20081
Inventor 任茂栋温自明周烨陆旺乔根魏小康赵建博张一驰鲁雷雷
Owner 新拓三维技术(深圳)有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products