Augmented reality visualization method based on depth camera and application

Abstract

The invention relates to an augmented reality visualization method based on a depth camera and an application. The method comprises the specific steps of 1, reconstructing background point cloud through the depth camera, and obtaining target object point cloud through three-dimensional modeling; 2, reconstructing an environment point cloud based on a depth camera; 3, key feature points of the target object point cloud and the filtered environment point cloud being extracted, point cloud registration being carried out, the pose of the target object under a depth camera coordinate system being obtained, and recognition and initial positioning of the target object being completed; 4, performing three-dimensional tracking registration based on RGBD feature points; 5, selecting a key frame according to the relative pose variation of the target object of the current key frame and the next frame of image for pose optimization of the target object, and completing updating of the target objectand the target area; and 6, realizing visualization of the occlusion features. According to the method, the target object can be well recognized in a complex scene, and the real-time performance, robustness and tracking accuracy of the system are improved.

Description

technical field [0001] The invention relates to technical fields such as computer vision, image acquisition and processing, and specifically relates to a depth camera-based augmented reality visualization method and application. Background technique [0002] Augmented reality technology is a branch of virtual reality technology. It uses computer-generated objects or information to integrate with the real environment. Awareness of the environment. [0003] Tracking registration technology, as the core of augmented reality technology, has been greatly developed. However, in some specific operation scenarios, due to the complex environment background, the operation target object is moving. To accurately locate and track the moving target object, this requires high real-time and robustness of the system. Some tracking registration methods are difficult to meet these needs. For example, the tracking and registration method based on natural feature points will cause error featu...

AI Technical Summary

Problems solved by technology

However, in some specific operation scenarios, due to the complex environment background, the operation target object is moving. To accurately locate and track the moving target object, this requires high real-time and robustness of the system. Some tracking registration methods are difficult to meet these needs

For example, the tracking and registration method based on natural feature points will cause error feature point interference due to the lack of texture features, and the accuracy is not high; the method based on markers needs to place markers in the real scene in advance, and when extreme angles or markers are blocked It will lead to registration failure; the model-based method needs to calculate the views from different angles, and the huge amount of calculation is difficult to guarantee the speed and accuracy of the system. Therefore, this application proposes a new type of positioning and tracking that can track moving targets and meet application requirements. way, and the visualization method of this application can accurately display the virtual information in the action scene, so that the information blocked by the moving object can be visualized, which has very important practical significance

Images