Digital virtual-real interaction system and digital virtual-real interaction method

Abstract

The invention discloses a digital virtual-real interaction system and a digital virtual-real interaction method. The digital virtual-real interaction system comprises a gesture acquisition device, a processing device and a display device. The digital virtual-real interaction method includes the steps of (1) tracking and capturing motion track of user's fingertip acquired by a camera, (2) drawing a track curve on a display in real time or displaying or recording of the track of the user's fingertip through a touch screen, (3) extracting a profile formed by the motion track, detecting the shape of the profile and giving semantics, (4) building a three-dimensional model base and managing three-dimensional models in a graphics library according to the semantics, (5) retrieving the three-dimensional model base according to the semantics of the hand-drawing track of the user, loading the corresponding three-dimensional models and displaying a three-dimensional virtual environment, and (6) performing dynamic interaction among the user, the three-dimensional model and the virtual environment so as to realize digital virtual-real interaction. The digital virtual-real interaction system and the digital virtual-real interaction method are adaptable to application fields of digital entertainment, virtual design, virtual-real interaction, virtual teaching and the like.

Description

technical field [0001] The invention relates to a digital virtual-real interaction system and method, belonging to the field of computer graphic image processing and virtual reality research. Background technique [0002] Virtual-real interaction is an important development direction in the field of human-computer interaction at present. Based on the combination of virtual and real technology, it provides users with an imaginative but realistic environment, allowing users to experience unprecedented experiences, and can also complete collaborative design, training, teaching, etc. target function. Using a camera to collect real user information (including gesture information, etc.), combining it with the 3D virtual world to build a virtual-real hybrid environment is a natural virtual-real interaction method, but how to generate users through random improvisation? There is no mature technology to interact with the 3D scene you want in your heart. [0003] In the field of art...

AI Technical Summary

Problems solved by technology

Wing Ho Leung of CMU et al. proposed the hierarchy of hand-drawn sketches in the document "Wing Ho Leung, Tsuhan Chen, Hierarchical Matching for Retrieval of Hand-Drawn Sketches, International Conference on Multimedia and Expo-Volume2, 2003, pp.29-32" The search method is based on the optimized matching retrieval method, which reduces the amount of calculation by matching strokes hand-drawn by the user and considering their spatial relationship, but still belongs to the process of two-dimensional processing

Images