Indoor reconstruction method and system based on hyperspectral, true color image and point cloud complementarity

A hyperspectral, point cloud technology, applied in the field of high-quality reconstruction of indoor 3D scenes, can solve problems such as missing point clouds, achieve stable reconstruction effect, improve quality, and avoid errors

Active Publication Date: 2021-10-01
HARBIN INST OF TECH
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The purpose of the present invention is to propose an indoor 3D reconstruction technology that integrates hyperspectral, 3D point cloud and true color image data, which solves the problem of missing point clouds caused by the insensitivity of light sources to materials, lighting conditions and heat during traditional 3D reconstruction. , proposed a method of using hyperspectral information to fill in missing point clouds, using color image data to correct point clouds, combined with other filtering techniques, and finally improved the quality and stability of 3D reconstruction, and further improved the application level

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Indoor reconstruction method and system based on hyperspectral, true color image and point cloud complementarity
  • Indoor reconstruction method and system based on hyperspectral, true color image and point cloud complementarity
  • Indoor reconstruction method and system based on hyperspectral, true color image and point cloud complementarity

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0073] The following describes the specific implementation of the present invention in conjunction with the examples and accompanying drawings: In the process of using the system for indoor three-dimensional reconstruction, considering factors such as operability, price, conditions of use, and accuracy, Microsoft Corporation's integrated vision technology was selected. The natural interactive device Kinect2 has a depth recognition range of 0.5m to 4.5m, and the size of the target laboratory selected for reconstruction is 7.8m*7.8m*4m. The hyperspectral imaging system selects a ground object hyperspectral imager.

[0074] Execute step 1: Due to the limitation of the acquisition depth of Kinect2, try to select the center with features in the room (such as figure 1 position_0) is used as the origin (0,0,0) of the world coordinate system. Since the room is relatively small, choose the single-point automatic rotation method to reconstruct the general situation of the room, and then ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

Indoor reconstruction method and system based on hyperspectral, true color image and point cloud complementarity, which involves scene adaptation, SVM-based spectrum recognition, point cloud closed-loop correction based on hyperspectral and true color image, distance statistics, greedy triangle and other methods . It solves the problem of point cloud acquisition equipment being insensitive to materials, light and heat, and fully automatic 3D reconstruction. The steps of the present invention are: 1. Obtaining initial data; 2. Identifying the missing position of the point cloud according to the hyperspectral data; 3. Preliminary correction of the three-dimensional point cloud information; 4. Correcting the repair result according to the true color map; 5. Point cloud Filtering, stitching automation, point cloud tessellation and texture mapping. The present invention uses hyperspectral and true-color image information to repair point clouds, which makes up for the lack of hardware and improves the quality of reconstruction. Through adaptive processing and full automation, the stability and practicability of 3D indoor reconstruction are improved. Get promoted, the application prospect is more and more broad.

Description

technical field [0001] The present invention is applied to indoor three-dimensional reconstruction in the field of virtual reality, and specifically uses hyperspectral information, three-dimensional point cloud information and true-color RGB image information to complete high-quality reconstruction of indoor three-dimensional scenes. Background technique [0002] 3D reconstruction technology is a popular research target in computer graphics and computer vision, ranging from the drawing of maps to the reconstruction of grain structures. It can be convenient for scientific research, and the application prospect is more and more broad. [0003] In recent years, in terms of indoor 3D reconstruction, there are binocular 3D reconstruction based on 2D images, real-time positioning and map construction (Simultaneous Localization And Mapping, SLAM) based on 3D depth information, etc. There are many products that collect depth information in the market, but because flat objects with ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06T17/05
CPCG06T17/05G06T2200/08G06T2207/10028
Inventor 姜宇李文强金玲贺亮金晶
Owner HARBIN INST OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap