Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Three-dimensional face reconstruction method and device, medium and equipment

A technology of three-dimensional face and face area, applied in the field of computer vision, can solve the problems of falling into local optimum and low accuracy of three-dimensional face, so as to improve the accuracy and efficiency, and reduce the probability of falling into the local optimum solution.

Pending Publication Date: 2019-07-26
BEIJING HUAJIE IMI TECH CO LTD
View PDF4 Cites 15 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] At present, the commonly used 3D face reconstruction technology is the active 3D reconstruction technology. The inventors found that in the application process of the active 3D reconstruction technology in the prior art, the point cloud registration tends to fall into the local optimal problem, resulting in the final reconstruction The accuracy of the 3D face is not high

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Three-dimensional face reconstruction method and device, medium and equipment
  • Three-dimensional face reconstruction method and device, medium and equipment
  • Three-dimensional face reconstruction method and device, medium and equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0073] Aiming at the problem that in the application process of the existing active 3D reconstruction technology, the point cloud registration is easy to fall into the local optimum, resulting in the problem that the accuracy of the final reconstructed 3D face is not high. This application provides a real-time premise Next, the 3D face reconstruction method with higher point cloud registration accuracy and faster convergence speed continuously fuses the depth information of multiple frames of faces, and finally reconstructs a complete 3D face.

[0074] Specifically, in the three-dimensional face reconstruction method provided by the present application, the concave or convex points in the surface formed by the point cloud are determined as feature points, and the average curvature and Gaussian curvature corresponding to the feature points are used as the attribute vectors of the feature points, and then Use the attribute vectors of the corresponding feature points of the two se...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a three-dimensional face reconstruction method, which comprises the following steps: obtaining point clouds respectively corresponding to two frames to be registered, and taking the point clouds as a first group of point clouds and a second group of point clouds; determining attribute vectors of feature points in the first group of point clouds and the second group of pointclouds, the feature points being concave points or convex points in a curved surface formed by the pointing point clouds, and the attribute vectors of the feature points comprising average curvaturesand Gaussian curvatures corresponding to the feature points; performing coarse registration on the first group of point clouds and the second group of point clouds according to the attribute vectorsof the feature points in the first group of point clouds and the second group of point clouds to obtain coarse registration initial values; performing fine registration on the first group of point clouds and the second group of point clouds based on the coarse registration initial value through a point cloud accurate registration algorithm; due to the fact that the rough registration initial providing value provides a good iteration initial position for fine registration, the problem that registration is trapped in local optimum is avoided, registration precision is improved, and then precision of the finally-built three-dimensional face model is improved. The invention further discloses a corresponding device, equipment and a medium.

Description

technical field [0001] The present application relates to the technical field of computer vision, and in particular to a three-dimensional face reconstruction method, device, computer-readable storage medium and equipment. Background technique [0002] 3D face reconstruction technology is a research hotspot in the field of computer vision, and it has a wide range of applications in face recognition, face replacement, face driving, and face editing. [0003] At present, the commonly used 3D face reconstruction technology is the active 3D reconstruction technology. The inventors found that in the application process of the active 3D reconstruction technology in the prior art, the point cloud registration tends to fall into the local optimal problem, resulting in the final reconstruction The accuracy of the 3D face is not high. Contents of the invention [0004] This application provides a 3D face reconstruction method, which uses the attribute vectors including the average ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T17/00G06K9/00
CPCG06T17/00G06V40/161G06V40/168
Inventor 王行徐康李骊周晓军盛赞李朔杨淼
Owner BEIJING HUAJIE IMI TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products