Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Depth integration and curved-surface evolution based multi-viewpoint three-dimensional reconstruction method

A three-dimensional reconstruction, multi-view technology, applied in the field of three-dimensional depth information acquisition system, can solve the problems of high complexity of complete solution energy function and difficult to deal with complex scenes, etc.

Active Publication Date: 2012-07-25
ZHEJIANG UNIV
View PDF3 Cites 23 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This type of method is usually based on the assumption that the depth edge and the color edge are consistent, and it is difficult to deal with complex scenes with similar foreground and background colors.
In addition, the energy function is usually not convex, which makes it easy to converge to a local optimal solution when the initial value deviates far from the true value, and the complexity of completely solving the energy function is high

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Depth integration and curved-surface evolution based multi-viewpoint three-dimensional reconstruction method
  • Depth integration and curved-surface evolution based multi-viewpoint three-dimensional reconstruction method
  • Depth integration and curved-surface evolution based multi-viewpoint three-dimensional reconstruction method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0084] The visible light camera uses a CCD sensor, which can provide color images with a resolution of 320×240. The depth camera used is a TOF camera, model Swiss Ranger 4000, which can provide depth images and intensity images with a resolution of 176×144 at the same time.

[0085] The specific calibration method of the camera array is as follows: firstly, the intensity image of the TOF camera is up-sampled to make its resolution reach 352×288; then, each CCD camera and TOF camera are calibrated using Zhang Zhengyou’s flat-panel camera calibration method, and the obtained The internal parameters of each camera, the external parameters projected from the TOF camera to each CCD camera, and the external parameters between the CCD cameras.

[0086] The general flowchart of the present embodiment method is shown in figure 1 , the specific method can be divided into the following three steps: the first step is to project the depth image obtained by the TOF camera into the field of ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a depth integration and curved-surface evolution based multi-viewpoint three-dimensional reconstruction method. The method comprises the following steps: firstly, calibrating a camera array consisting of depth cameras and visible light cameras, projecting depth maps obtained by the depth cameras to a viewpoint in the array by using calibration parameters so as to obtain an initial depth map of the viewpoint, and then obtaining an initial depth curved-surface according to the initial depth map; secondary, defining a curved-surface evolution based energy function, wherein the definition of the energy function comprises the color consistency cost of a plurality of cameras, and the uncertainty and curved-surface smoothing items of the initial depth curved-surface; and finally, driving the depth curved-surface evolution through convexification and minimization on the energy function so as to obtain a final depth curved-surface, namely, three-dimensional scene information. According to the invention, the initial depth information and the color consistency cost of a plurality of cameras are simultaneously fused, therefore, the method is a three-dimensional reconstruction method by which scene space information can be effectively obtained, and can meet various application requirements in three-dimensional televisions, virtual realities and the like.

Description

technical field [0001] The invention relates to a three-dimensional depth information acquisition system, in particular to a multi-viewpoint three-dimensional reconstruction method based on depth fusion and surface evolution. Background technique [0002] With the development of information technology and computer technology, three-dimensional information acquisition technology has become a key technology in the fields of biomedicine, virtual reality, film and television entertainment, etc. Reconnaissance and other fields have broad application prospects. In the above fields, people's requirements for 3D acquisition technology are getting higher and higher. At present, three-dimensional acquisition technologies such as multi-eye stereo vision technology, structured light technology, DFM (depth from motion), SFM (structure from motion) and TOF (Time of Flight) are mainly used. None of the techniques can well meet the requirements of real-time, high precision, high resolutio...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T17/00G06T7/00
Inventor 于慧敏杨刚
Owner ZHEJIANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products