Virtual reality realization method based on augmented reality

Abstract

The invention discloses a virtual reality realization method based on the augmented reality. The method includes: 1) acquiring a depth image sequence and a RGB sequence of a scene through a camera; 2) generating a RGBD four-channel image sequence of the scene according to the acquired depth image sequence and the RGB sequence; 3) calculating a rotation matrix and a translation vector of the camera between two frames according to the RGBD, recognizing a target object and a planar structure in the scene and position information thereof in the three-dimensional space from the RGBD of the scene, and converting the RGBD to a binocular view sequence; and 4) presenting the binocular view sequence on a screen of the camera, drawing a virtual three-dimensional model of the target object in the scene according to the position information of the planar structure in the three-dimensional space in the scene, transforming the virtual three-dimensional model according to the rotation matrix and the translation vector of the camera, and enabling the virtual three-dimensional model and the attached planar structure to be relatively static. According to the method, the image to be presented can be accurately and rapidly calculated.

Description

technical field [0001] The invention belongs to the field of augmented reality, and in particular relates to a virtual reality realization method based on augmented reality. Background technique [0002] Virtual reality (Virtual Reality, hereinafter referred to as VR) technology is a computer simulation system that can create and experience a virtual world. It uses a computer to generate a simulated environment, which is a multi-source information fusion and interactive three-dimensional dynamic scene. System simulation of physical and physical behavior immerses users in the environment. [0003] Augmented Reality (AR for short) is a technology that calculates the position and angle of camera images in real time and adds corresponding images, videos, and 3D models. The goal of this technology is to put the virtual world on the screen. the real world and interact with it. This technique was proposed in 1990. With the improvement of the CPU computing power of portable elect...

AI Technical Summary

Problems solved by technology

[0006] At present, there are three main difficulties in augmented reality technology: first, the integration of real scenes and virtual objects requires new display technology; On this basis, virtual objects can be accurately displayed. Compared with the color binocular camera system, this computer vision system adopts the fusion of color and depth sensors, which can more accurately obtain the 3D model information of the scene and the color information corresponding to each pixel. The calculation cost is greatly saved and the accuracy is increased during 3D scene measurement, which requires the foundation of powerful computer vision measurement hardware capabilities and accurate and fast algorithms to calculate the images to be presented; the third is to bring augmented reality technology into people's lives Daily life requires further development of free interaction technology based on gestures, actions, and voice

Images