Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Speckle-based three-dimensional-face reconstruction method and device

A three-dimensional face and speckle technology, which is applied in the field of three-dimensional face reconstruction based on speckle, can solve the problems of slow calculation efficiency, low accuracy of speckle image, and low precision, and achieve high-precision three-dimensional face reconstruction. effect, reduce the search scope, and improve the overall efficiency

Active Publication Date: 2018-11-02
WISESOFT CO LTD
View PDF10 Cites 24 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The Chinese patent application with the application number 200910093767.2 discloses another 3D face reconstruction method, which uses the texture component of the face deformation model to fit the face texture, but the accuracy of the speckle image is still not high, and the generated model is different from the real one. There is a certain gap in the face
Existing 3D reconstruction technologies all have the technical problems of large amount of calculation and computational efficiency, slow reconstruction speed and low precision

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Speckle-based three-dimensional-face reconstruction method and device
  • Speckle-based three-dimensional-face reconstruction method and device
  • Speckle-based three-dimensional-face reconstruction method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0024] In the following, the present invention will be further described in detail in conjunction with the accompanying drawings and embodiments, so as to make the purpose, technical solutions and advantages of the present invention more clear. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0025] figure 1 The main flow of the speckle-based three-dimensional face reconstruction method according to the embodiment of the present invention is shown. The method of this embodiment comprises the following steps:

[0026] Step 101: Input multiple speckle image pairs conforming to binocular stereo vision

[0027] Specifically, the stored speckle image pair can be directly read from the memory, or can be acquired through a binocular stereo vision system with a speckle structured light projector. Specifically, the speckle structured light projector projects multiple different s...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a speckle-based three-dimensional-face reconstruction method and device. The method and the device can reduce matching calculation quantity while image feature richness is improved, and realize synchronized improvement of three-dimensional-face reconstruction efficiency and reconstruction precision. The method comprises: inputting a plurality of speckle image pairs conforming to binocular stereo vision; carrying out polar line correction on the input speckle image pairs to enable corresponding matching points to be at the same horizontal lines; carrying out face detection on the speckle image pairs after polar line correction, and extracting region-of-interest image pairs of to-be-reconstructed faces; carrying out first matching processing on the region-of-interestimage pairs to obtain first parallax graphs; setting a matching point searching range according to parallax in the first parallax graphs, and carrying out second matching processing on the region-of-interest image pairs to obtain second parallax graphs; and generating corresponding three-dimensional point cloud data according to the second parallax graphs and camera calibration parameters to obtain the reconstructed three-dimensional faces.

Description

technical field [0001] The invention relates to the technical field of multi-eye stereo vision, in particular to a speckle-based three-dimensional face reconstruction method and equipment. Background technique [0002] At present, 3D data is widely used in aerospace, 3D printing, geographic mapping, face detection and many other fields. Real-time and accurate acquisition of space-time data has always been the core issue of 3D information collection and 3D scene reconstruction, and it is also a hot research direction in the field of computer geometry. [0003] 3D face modeling stems from Parke's pioneering research to generate realistic 3D faces by computer. Obtaining 3D face depth information is the basic prerequisite for reconstructing a high-precision 3D face model, and 3D face data can be collected through monocular or multi-eye cameras. [0004] Among them, the main application scenario of multi-eye stereo vision is to restore the two-dimensional projection image to a ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T17/00
CPCG06T17/00G06T2207/10012G06T2207/20104G06T2207/30201
Inventor 傅可人谢宜江朱江平荆海龙
Owner WISESOFT CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products