Information processing method, device, cloud processing device and computer program product

Abstract

The invention provides an information processing method, device, cloud processing device and computer program product, is applied to the field of data processing technology, is capable of performing three-dimensional reconstruction and semantic segmentation at the same time, namely, acquiring semantic information at the same time of performing three-dimensional reconstruction based on RGBD data, so as to shorten calculation time and to improve scene segmentation precision. According to the invention, the method includes acquiring RGBD data collected by an image collection device; extracting key frame data in the RGBD data and performing processing and obtaining geometric reconstruction data; performing mapping treatment on the RGB data in the key frame data and the geometric reconstructiondata and obtaining three-dimensional reconstruction data; and performing semantic segmentation treatment on the RGB data in the key frame data and obtaining semantic segmentation data; performing mapping treatment on the semantic segmentation data and the three-dimensional reconstruction data and obtaining three-dimensional semantic map.

Description

technical field [0001] The present invention relates to the technical field of data processing, and in particular to an information processing method, device, cloud processing device and computer program product. Background technique [0002] Semantic map construction refers to the computer and other equipment based on perception data, cognition and understanding of the environment, comprehensive analysis of the data, and extraction of high-level semantic information (such as object names and locations) that can be used for autonomous decision-making by the equipment. Among them, the acquisition of perception data can be realized through key technologies such as radio frequency identification technology, auditory technology, and visual technology. At present, most researches focus on visual technology. [0003] In the specific operation process of generating a semantic map, you can rely on deep learning technology. The image perceived by the computer in real time may contain...

AI Technical Summary

Problems solved by technology

[0003] In the specific operation process of generating a semantic map, you can rely on deep learning technology. The image perceived by the computer in real time may contain multiple objects. Recognition, the process involves a large number of image operations and takes a long time

[0004] However, the processing methods in the prior art are mainly aimed at the processing of two-dimensional data. When performing semantic segmentation on three-dimensional data, geometrically continuous segmentation results cannot be obtained by using this method, and limited by the number of samples, it can be segmented into The types of objects are limited and time-consuming

Images