Interactive display device based on augmented reality and interactive display method thereof

Abstract

The invention relates to an interactive display device based on augmented reality and an interactive display method thereof. The device comprises a visual perception unit, a sound input and output unit, an augmented reality processing unit and a video output unit. The augmented reality processing unit comprises a voice recognition module, a gesture recognition module, a target positioning module,a three-dimensional registration module and a virtual object superposition module. The method comprises the following steps: detecting and displaying an acquired original video; tracking the target object; when the time of continuously tracking the target object is greater than T1, the target object is tracked; identifying the voice collected from the voice input / output unit, selecting an augmented reality mode according to the identified voice instruction, superposing a virtual effect, selecting the augmented reality mode according to whether a current target object is tracked and whether a new voice instruction exists, and continuously superposing the virtual effect or ending the augmented reality interactive display. The augmented reality technology and the artificial intelligence technology are fully utilized, and the user experience of interactive display is effectively improved.

Description

technical field [0001] The present invention relates to the field of augmented reality (Augmented Reality, AR), in particular to an augmented reality-based interactive display device and an interactive display method thereof. Background technique [0002] With the development of information technology, people's sensory experience of reality is constantly changing. In recent years, AR technology has gradually attracted people's attention. It superimposes the virtual scene on the display screen into the real scene after simulating the physical information that is difficult to experience in the real world within a certain time and space. , so as to achieve a sensory experience beyond reality. At present, AR technology has been gradually applied in various fields such as games, commerce, industry, construction, education, and medical care, such as the fitting mirror launched by JD.com, the AR game "Pokémon GO" launched by Niantic, and the AR glasses released by Google. [0003...

AI Technical Summary

Problems solved by technology

Although the patent can enhance tourists' sense of real experience, the scope of application is relatively limited, and the enhanced real-scene content and interaction methods are still relatively single

[0004] In order to solve the above-mentioned shortcoming of single interactive mode of the AR system and increase the selectivity of virtual objects, the present invention provides an augmented reality-based interactive display device and its interactive display method on the basis of the prior art, which can not only provide Adding virtual objects to the real scene can also be interactively displayed through gestures, voice, etc., so as to bring users a good interactive experience, and is suitable for various places with a lot of people.

Images