Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

3D face reconstruction method based on multi-view mobile phone selfie images

A 3D face and multi-view technology, applied in the field of computer vision, can solve problems such as inapplicability and inaccurate 3D face models

Active Publication Date: 2017-06-13
WISESOFT CO LTD
View PDF1 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the 3D face model reconstructed based on the left and right channel images collected by two cameras is not accurate enough.
In addition, in this solution, the mutual positional relationship between the two cameras installed on the mobile phone or tablet computer is fixed, and the 3D face model is reconstructed based on the left and right channel images of the two cameras. mobile phone, this solution cannot be applied

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • 3D face reconstruction method based on multi-view mobile phone selfie images
  • 3D face reconstruction method based on multi-view mobile phone selfie images
  • 3D face reconstruction method based on multi-view mobile phone selfie images

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0025] The present invention will be further described in detail below in combination with specific embodiments. However, it should not be understood that the scope of the above subject matter of the present invention is limited to the following embodiments, and all technologies realized based on the content of the present invention belong to the scope of the present invention.

[0026] The 3D face model can help improve the recognition rate of the face recognition system, while taking into account the anti-counterfeiting function. At present, there are relatively few studies on 3D face data acquisition technology. However, with the popularity of mobile phone photography, people can easily use mobile phones to obtain images from various angles of the face. The invention utilizes the Selfie image of the mobile phone to quickly reconstruct an accurate three-dimensional human face model. Details are given below.

[0027] Such as figure 1 Shown based on the three-dimensional f...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a three-dimensional facial reconstruction method based on multi-view cellphone selfie pictures. The three-dimensional facial reconstruction method includes automatically positioning mark points on selfie face images of a same person from n different angles; setting up a first energy function according to the mark points and solving a camera parameter Pk (k=1,....,N), wherein in the first energy function, I is pixel serial number, k is input image vision number, mi is the ith mark point, Xi is three-dimensional point coordinate corresponding to the ith mark point, and Pk is a projection transformation matrix from a three-dimensional point to the corresponding image; reconstructing a target function E=Edata+Ecolor+Esmooth according to the camera parameter, optimizing the target function and using a multi-tag image partition algorithm to solve the target function to obtain a three-dimensional facial model. By the three-dimensional facial reconstruction method, the accurate three-dimensional facial model can be reconstructed quickly by the cellphone selfie images.

Description

technical field [0001] The invention relates to the field of computer vision, in particular to a three-dimensional face reconstruction method based on multi-view selfie images of mobile phones. Background technique [0002] Mobile phones are currently the most widely used portable electronic devices. With the popularization of mobile phone photography, people can easily use mobile phone selfies to obtain images from various angles of the face. At the same time, there are also a large number of self-portrait face images in everyone's mobile phone. However, at present, mobile phones do not have a depth sensor, so they cannot obtain the depth image of the face in real time and establish a 3D model of the face, which makes the mobile phone selfie lack of three-dimensionality and vividness. [0003] The application number is CN201310161450.4, and the Chinese patent titled a three-dimensional imaging device for a mobile phone or a tablet computer discloses a scheme for building ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06T7/55
CPCG06T15/06G06T17/00G06T2207/30201G06T2215/06
Inventor 李靓
Owner WISESOFT CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com