Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Three-dimensional face reconstruction method and device, electronic equipment and storage medium

A three-dimensional face and three-dimensional technology, applied in the field of computer vision, can solve the problems of increased running time, increased computational cost, and no support for large poses, and achieves the effect of speeding up and improving robustness and stability.

Pending Publication Date: 2022-03-15
SOUTH CHINA NORMAL UNIVERSITY
View PDF0 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The disadvantage of the optimization-based method is that it needs to rely on a large-scale 3D face database to construct a face model, and involves a large number of iterative fitting calculations.
The common problems of deep learning-based methods are: (1) The introduction of deep convolutional networks (such as VGG16) will increase the computational cost, increase the running time, and rely on high-performance processors
If the number of layers of the neural network is directly reduced, it is easy to cause the model to not fit well
(2) Insufficient stability and robustness of reconstruction results
Specifically, most 3D face reconstruction methods usually do not support face images with large poses (e.g., face yaw angle up to 90°), which will cause distortion of the reconstructed model

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Three-dimensional face reconstruction method and device, electronic equipment and storage medium
  • Three-dimensional face reconstruction method and device, electronic equipment and storage medium
  • Three-dimensional face reconstruction method and device, electronic equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0067] In order to make the purpose, technical solutions and advantages of the present application, the following will be further described in connection with the accompanying drawings.

[0068] It should be clear that the described embodiments are merely the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application embodiment, one of ordinary skill in the art is in the scope of the present application embodiment without creative labor premise.

[0069] The terms used in the present application examples are for purposes of describing particular embodiments, not intended to limit the embodiments of the present application. "One", "one", "one", "" ",", "" "and" "" as used in the present application embodiment and the appended claims, are also intended to include many forms unless the context clearly represents other meanings. It should also be understood that the terms "and / or" as used herein refer to any or more of any...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a three-dimensional face reconstruction method and device, electronic equipment and a storage medium. The three-dimensional face reconstruction method comprises the following steps: acquiring a face image to be reconstructed; preprocessing the face image to obtain a face image with a standard size; inputting the face image with the standard size into a trained face parameter recognition model to obtain a face parameter corresponding to the face image; wherein the face parameters comprise a posture parameter, a shape parameter and an expression parameter; according to the face parameters, three-dimensional vertex coordinates corresponding to the face image are obtained through calculation; and storing the three-dimensional vertex coordinates to obtain a complete file containing the three-dimensional face model. According to the three-dimensional face reconstruction method provided by the invention, three-dimensional face reconstruction based on a single face image can be realized, and high-precision three-dimensional face data does not need to be acquired.

Description

Technical field [0001] The present invention relates to the field of computer visual technology, and in particular, there is a three-dimensional face reconstruction method, a device, an electronic device, and a storage medium. Background technique [0002] Three-dimensional face rebuild has been a hot topic in computer visual fields. The three-dimensional face reconstruction can be applied to face recognition, face alignment, face animation, etc. In recent years, although researchers have proposed a number of three-dimensional face rebuild, it is still a challenge from the four-dimensional image. To simplify problems, researchers will use the three-dimensional face model or template to perform reconstruction tasks, the most common model is a three-dimensional modified model (3DMorphable Model, 3DMM). [0003] At present, 3DMM-based three-dimensional face reconstruction methods can be roughly divided into two categories: optimized methods and methods based on deep learning. [000...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T17/00G06V40/16G06V10/82G06N3/04G06N3/08
CPCG06T17/00G06N3/08G06N3/048G06N3/045
Inventor 梁艳邓卓然何龙健
Owner SOUTH CHINA NORMAL UNIVERSITY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products