Complex scene rehabilitation training method based on reality augmentation technology

Abstract

The invention relates to a complex scene rehabilitation training method based on a reality augmentation technology. The complex scene rehabilitation training method comprises the following steps: a, constructing a three-dimensional database of model components for aided training of an amblyopia patient; b, collecting a binocular image of a real scene by using a binocular camera, extracting three-dimensional features of the real scene, and reconstructing a complex scene; c, performing real-time adaptive three-dimensional registration on the three-dimensional data of the model component and thereconstructed scene image; d, quickly estimating the illumination condition of the real scene and reconstructing the illumination distribution of the scene; and e, performing real-time drawing and dynamic fusion on the auxiliary training information and the reconstructed scene image, and guiding the patient to perform real-time interaction with the enhanced real scene. The vision rehabilitation training device faces different visual impairment groups such as blind people, low-vision people and old people with visual impairment, helps the blind people, the low-vision people and the old people to perceive the surrounding environment and can conduct vision assistance, vision rehabilitation training and the like on the blind people, and life and rehabilitation ability of weak-vision groups aregreatly facilitated.

Description

technical field [0001] The invention relates to the field of reality augmentation technology, in particular to a complex scene rehabilitation training method based on reality augmentation technology. Background technique [0002] Augmented Reality (AR for short) is a technology that calculates the position and angle of the camera image in real time and adds the corresponding image. It is a new technology that "seamlessly" integrates real world information and virtual world information. The goal of this technology is to put the virtual world on the screen and interact with the real world. This technique was first proposed in 1990. With the improvement of the computing power of portable electronic products, the use of augmented reality is becoming more and more extensive. [0003] 3D reconstruction (3D Reconstruction) refers to the establishment of a mathematical model suitable for computer representation and processing of three-dimensional objects. It is the basis for proce...

AI Technical Summary

Problems solved by technology

[0006] The purpose of the present invention is to provide a complex scene rehabilitation training method based on reality augmentation technology to solve the problems of difficult rehabilitation training for visually impaired people and unsatisfactory training effect

Images