Three-dimensional face reconstruction method and device, electronic equipment and storage medium

A technology of 3D face and face key points, which is applied in the field of electronic equipment, can solve the problems of poor detail and lack of fidelity of 3D face

Pending Publication Date: 2021-05-18
GUANGDONG OPPO MOBILE TELECOMM CORP LTD
View PDF0 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Currently, 3D face reconstruction based on a single RGB image has poor details and lacks realism

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Three-dimensional face reconstruction method and device, electronic equipment and storage medium
  • Three-dimensional face reconstruction method and device, electronic equipment and storage medium
  • Three-dimensional face reconstruction method and device, electronic equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0021] In order to enable those skilled in the art to better understand the solutions of the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application.

[0022] At present, the classic method of 3D face reconstruction based on a single RGB image is 3D morphable model (3Dmorphable model, 3DMM). The basic idea is to collect 3D faces in advance and complete the establishment of the database. Perform principal component analysis on the shape vector, expression vector and texture vector of the face, and convert these vectors into independent representations. On this basis, any face can be represented by a linear combination of the average face and the principal components. The inventor found through research that there are two important but often overlooked problems in 3DMM: 1. After collecting the original 3D face scan data, ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a three-dimensional face reconstruction method and device, electronic equipment and a storage medium, and relates to the technical field of electronic equipment. The method comprises the following steps: acquiring a shape parameter and a texture parameter of a to-be-reconstructed face, inputting the shape parameter into a first model to obtain a three-dimensional face shape output by the first model, and inputting the texture parameter into a second model to obtain a face texture map output by the second model, wherein, at least one of the first model and the second model is obtained based on generative adversarial network training, a target three-dimensional face is generated based on the three-dimensional face shape and the face texture map, and the target three-dimensional face comprises texture information generated based on the face texture map. According to the method, the three-dimensional face shape and / or the face texture map are / is generated through the trained generative adversarial network, so that the generated target three-dimensional face has rich detail features, and the reconstruction effect of the three-dimensional face is improved.

Description

technical field [0001] The present application relates to the technical field of electronic equipment, and more specifically, to a reconstruction method, device, electronic equipment and storage medium for a three-dimensional human face. Background technique [0002] In the field of computer vision and computer graphics, 3D face reconstruction is a hot topic gradually, because it can be widely used in face recognition, face editing, human-computer interaction, expression-driven animation, augmented reality, virtual reality and other fields. The 3D face reconstruction based on a single RGB image—that is, reconstructing the shape and texture of a 3D face from a single RGB image—is an enduring topic. Currently, 3D face reconstruction based on a single RGB image has poor details and lacks realism. Contents of the invention [0003] In view of the above problems, the present application proposes a three-dimensional face reconstruction method, device, electronic equipment and ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T17/00G06T15/00G06T15/50G06N3/04G06N3/08
CPCG06T17/00G06T15/00G06T15/506G06N3/08G06N3/045
Inventor 俞云杰黄晗郭彦东
Owner GUANGDONG OPPO MOBILE TELECOMM CORP LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap