A Method of 3D Mesh Reconstruction Using a Single Color Image

A technology of 3D grids and color maps, applied in the field of 3D vision, can solve the problems of high degree of freedom of generated points, low resolution of output grid, lack of details of the model, etc., to achieve improved reconstruction accuracy, smooth generated results, and stable learning process Effect

Active Publication Date: 2021-02-26
FUDAN UNIV
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, this method is limited by the poor ability to expand category information, and the reconstructed model is severely lacking in details
[0007] The paper [3] reconstructs the three-dimensional raster. Due to the limitation of GPU memory and calculation amount, the output raster usually has a very low resolution.
Recently, the paper [4] proposed an octree representation method, which can reconstruct a model with a slightly higher resolution under the limited GPU memory budget, but the 3D grid is still not a commonly used representation method in the film and game industries.
[0008] The article [5] proposes a method to generate a point cloud from a single image. Since there is no local connection between the points, the degree of freedom of the position movement of the generated point is too high, so the reconstructed point cloud model lacks shape and surface details.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A Method of 3D Mesh Reconstruction Using a Single Color Image
  • A Method of 3D Mesh Reconstruction Using a Single Color Image
  • A Method of 3D Mesh Reconstruction Using a Single Color Image

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0024] Step 1. Acquire 3D data and corresponding 2D images. This method synthesizes images by rendering a CAD model with randomly initialized camera parameters. This method requires 3D point cloud data containing normal vector information. First, some points are sampled using Poisson distribution on the original CAD model, and the normal vector of each surface in CAD is recorded. Then judge whether each point satisfies the plane equation. If so, then use the convex hull algorithm to judge whether the point falls inside the surface. If both conditions are met, record the normal vector of this point as the plane normal vector.

[0025] Step 2. Use MeshLab software to build an ellipsoid three-dimensional mesh. First, set the ellipsoid space equation in the 3D data processing software MeshLab, and then set the number of nodes, specifically including 156 vertices and 308 faces, and then get the initial triangular ellipsoid mesh model, the ellipsoid is used as the method of this me...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention belongs to the technical field of three-dimensional vision, and specifically relates to a method for reconstructing a three-dimensional mesh model of an object by using a single color image. The method of the present invention includes, for images, designing a multi-layer full convolution feature network for extracting the features of different levels of pictures; The ellipsoid is deformed to approximate the real shape; at the same time, the projection layer is designed to connect the image side and the 3D grid side, and an end-to-end neural network is trained under this framework, that is, given a color map, the corresponding 3D grid is output Model. This method has the advantages of smooth, complete and detailed 3D modeling results, and the reconstruction accuracy has also been effectively improved, which is very suitable for practical applications in industries such as virtual reality, animation games, and manufacturing.

Description

technical field [0001] The invention belongs to the technical field of three-dimensional vision, and in particular relates to a method for reconstructing a three-dimensional mesh model of an object by using a single color image. Background technique [0002] There are many representations of 3D data, including stereo raster, point cloud, mesh, etc. Stereo grid is a regular data structure, that is, objects are represented as N*N*N matrices, limited by resolution and expressive ability, this representation method usually lacks details and is difficult to represent complex shapes; 3D point cloud is a Irregular data structure, because there is no local connection relationship between points, the point cloud can only represent the approximate shape of the object, lacking the surface information of the object; the 3D grid is also an irregular data structure, composed of points, edges and Due to its light weight and rich shape details, it is more and more widely used in practical ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06T17/20
CPCG06T17/20G06N3/08G06T19/20G06T17/10G06T2219/2021G06T2219/2012G06N3/045
Inventor 姜育刚付彦伟王南洋张寅达李著文
Owner FUDAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap