Visual tracking and positioning method based on dense point cloud and composite view

Abstract

The invention provides a visual tracking and positioning method based on dense point cloud and a composite view, and the method comprises the steps: carrying out the three-dimensional scanning of a real scene, obtaining a color key frame image and a corresponding depth image, carrying out the image restoration, and carrying out the image coding of the key frame image; performing image coding on acurrent frame image acquired by the camera in real time, and selecting a composite image closest to the current frame image as a reference frame image of the current image; obtaining stable matching feature point sets on the two images, and performing processing to obtain six-degree-of-freedom pose information of the current frame camera relative to a three-dimensional scanning point cloud coordinate system; and performing judging by using an optical flow algorithm, if the requirement cannot be met, updating the current frame image to be the next frame image acquired by the camera, and performing re-matching. According to the invention, the association problem of the three-dimensional point cloud obtained by the laser radar and the heterogeneous visual image can be solved, and the effect of realizing visual navigation rapid initialization positioning is achieved.

Description

technical field [0001] The invention belongs to the field of information technology, and in particular relates to a visual tracking and positioning method based on dense point clouds and synthetic views. Background technique [0002] Visual real-time tracking and positioning of large-scale outdoor scenes has always been an important research direction in the field of computer vision. Outdoor complex and changeable environmental factors, such as lighting, viewing angle, occlusion, weak texture, and objects moving over time, all have a greater impact on the accuracy and robustness of the visual tracking and positioning algorithm. Outdoor combat scenes such as deserts, grasslands, and mountains have a large area and the scene texture information is not rich, which poses higher technical challenges to the visual tracking and positioning algorithm. At present, the commonly used outdoor large scene visual tracking and positioning algorithm is the SLAM (real-time positioning and m...

AI Technical Summary

Problems solved by technology

[0004] The purpose of the present invention is to overcome the defects of the prior art, in order to solve the problem of the association between laser radar three-dimensional scanning data and image data, so that it can be used for visual tracking and positioning, and propose a visual tracking based on dense point cloud and synthetic view positioning method

Images