Mobile augmented reality registration method of outdoor wide-range natural scene

Abstract

The invention provides a mobile augmented reality registration method of an outdoor wide-range natural scene. The mobile augmented reality registration method comprises the steps that three-dimensional reconstruction of feature points is accomplished through an Euclidean reconstruction method on the basis of combination between an essential matrix and triangulation, the initial external reference of a camera is calculated by using the essential matrix, a coordinate system of a virtual three-dimensional object and a coordinate system of the scene plane are built, feature detection and tracking are carried out by using a BRISK operator, tracking is only carried out on an image which is successfully recognized, and the speed of real-time updating of registration information is further increased. Tracking is carried out on the detected scene feature points through a light stream tracking method, scene feature information can be updated in real time, and real-time performance of augmented reality registration is further improved.

Description

technical field [0001] The invention belongs to the fields of augmented reality and computer vision. Specifically, the invention relates to a mobile augmented reality registration method for outdoor large-scale natural scenes, which is a basic technology for augmented reality applications. Background technique [0002] Augmented Reality (AR for short) is a research hotspot in recent years and has broad application prospects. It superimposes information generated by computers (including images, text, 3D models and lighting, etc.) Real-world enhancements. Therefore, unlike traditional virtual reality (Virtual Reality, referred to as VR), augmented reality is only a supplement to the real environment rather than a complete replacement of the real environment. Augmented reality technology enhances the user's perception of the real world and the ability to interact with the real world. It has broad application prospects in military, industry, medical, education, culture, entert...

AI Technical Summary

Problems solved by technology

[0007] In 2009, scholar T.Guan et al. (Document 1.T.Guan; C.Wang. "Registration Based on Scene Recognition and Natural Features Tracking Techniques for Wide-Area Augmented Reality Systems", IEEE Transactions On Multimedia, 2009, 11(8 ), 1393-1405.) In order to correctly identify natural scenes, a large number of reference views are saved, and natural scenes are identified through local feature matching methods, but the algorithm is very computationally intensive and cannot be applied to smartphones

However, it is necessary to use a computer to perform 3D reconstruction of all scenes in advance, to establish the 2D relationship between the 3D points of the scene and the related images of the scene, and to manually download the coordinates of the 3D points of the scene where the user is located, in order to realize the subsequent tracking and registration algorithm. Otherwise, a huge search space will be generated, which is difficult to meet the real-time requirements

Images