Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

High spectrum, true color image and point cloud complementary indoor reconstruction method and system

A hyperspectral and point cloud technology, applied in the field of high-quality reconstruction of indoor 3D scenes, can solve problems such as lack of point clouds and achieve the effect of improving recognition accuracy

Active Publication Date: 2018-10-09
HARBIN INST OF TECH
View PDF4 Cites 22 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The purpose of the present invention is to propose an indoor 3D reconstruction technology that integrates hyperspectral, 3D point cloud and true color image data, which solves the problem of missing point clouds caused by the insensitivity of light sources to materials, lighting conditions and heat during traditional 3D reconstruction. , proposed a method of using hyperspectral information to fill in missing point clouds, using color image data to correct point clouds, combined with other filtering techniques, and finally improved the quality and stability of 3D reconstruction, and further improved the application level

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • High spectrum, true color image and point cloud complementary indoor reconstruction method and system
  • High spectrum, true color image and point cloud complementary indoor reconstruction method and system
  • High spectrum, true color image and point cloud complementary indoor reconstruction method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0073] The following describes the specific implementation of the present invention in conjunction with the examples and accompanying drawings: In the process of using the system for indoor three-dimensional reconstruction, considering factors such as operability, price, conditions of use, and accuracy, Microsoft Corporation's integrated vision technology was selected. The natural interactive device Kinect2 has a depth recognition range of 0.5m to 4.5m, and the size of the target laboratory selected for reconstruction is 7.8m*7.8m*4m. The hyperspectral imaging system selects a ground object hyperspectral imager.

[0074] Execute step 1: Due to the limitation of the acquisition depth of Kinect2, try to select the center with features in the room (such as figure 1 position_0) is used as the origin (0,0,0) of the world coordinate system. Since the room is relatively small, choose the single-point automatic rotation method to reconstruct the general situation of the room, and then ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a high spectrum, true color image and point cloud complementary indoor reconstruction method and system, belongs to methods including scene adaption, SVM based wave spectrum identification, high spectrum and true color image based cloud point closed-loop correction and distance calculation and greedy triangles, and solves the problem that a cloud point obtaining device isnot sensitive to material, illumination, heat and the like and the problem in full automation of 3D reconstruction. The method comprises the steps that 1) initial data is obtained; 2) a deletion position of the cloud point is identified from high spectrum data; 3) cloud information of 3D points is corrected preliminarily; 4) a repair result is corrected according to a true color image; and 5) thepoint cloud is filtered, splicing is automatic, the point cloud is made into a patch, and texture is mapped. The high spectrum and true color image information is used to repair the point cloud, disadvantages of hardware are overcome, the reconstruction quality is improved, 3D indoor reconstruction is more stable and more practical via realization of adaption and full automation, and the method and system have wider application prospects.

Description

technical field [0001] The present invention is applied to indoor three-dimensional reconstruction in the field of virtual reality, and specifically uses hyperspectral information, three-dimensional point cloud information and true-color RGB image information to complete high-quality reconstruction of indoor three-dimensional scenes. Background technique [0002] 3D reconstruction technology is a popular research target in computer graphics and computer vision, ranging from the drawing of maps to the reconstruction of grain structures. It can be convenient for scientific research, and the application prospect is more and more broad. [0003] In recent years, in terms of indoor 3D reconstruction, there are binocular 3D reconstruction based on 2D images, real-time positioning and map construction (Simultaneous Localization And Mapping, SLAM) based on 3D depth information, etc. There are many products that collect depth information in the market, but because flat objects with ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T17/05
CPCG06T17/05G06T2200/08G06T2207/10028
Inventor 姜宇李文强金玲贺亮金晶
Owner HARBIN INST OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com