Augmented reality-based vision synthesis system

Abstract

The invention relates to an augmented reality-based vision synthesis system. The augmented reality-based vision synthesis system can be used for realizing virtual and real fusion. According to the system, a real scene is adopted as a background, virtual information adopted as a covering layer, is displayed on the real scene so as to be rendered. The working process of the system mainly comprises the following four steps: off-line calibration: the internal parameters of a real camera are determined, and relative relationships of the position and attitude of an aircraft and the position and attitude of the camera are determined; real-time online tracking: a world coordinate system is established, and the external parameters of the camera are calculated; three-dimensional object projection: a virtual space obtains three-dimensional models in a certain range from a database according to the position and attitude of the camera, and the three-dimensional models are projected onto a virtual imaging surface, so that virtual three-dimensional object projection can be completed; and virtual and real fusion: virtual information, adopted as a covering layer, is displayed on a real scene so as to be rendered, and therefore, data fusion can be realized.

Description

technical field [0001] This patent relates to a large field of view real image visual display system, which belongs to the field of virtual reality display technology. Background technique [0002] The flight vision system is a new type of flight perception system, which can provide pilots with visualized flight scene information. Compared with the traditional blue and brown "sky and earth", the explicit vision system can more intuitively reflect richer information to the pilot. At present, the flight vision system mainly includes Synthetic Vision System (SVS) and Enhanced Vision System (Enhanced Vision System, EVS), both of which can use airborne sensing equipment to generate special visual scenes. The visual system can build a completely virtual flight scene for the pilot based on the database, while the enhanced visual system displays the external scene information obtained by the airborne sensor equipment (such as infrared camera, millimeter wave radar) in the visual sc...

AI Technical Summary

Problems solved by technology

These two vision schemes can improve the pilot's perception of the outside world and the white body of the aircraft, but they also have their own shortcomings: for example, the synthetic vision system needs to carry a large amount of database information, while the sensor detection information displayed by the enhanced vision system lacks accurate information. Emphasis

Images