Movable gesture interaction device and method capable of being used for augmented reality game

A technology of augmented reality and interactive devices, applied in the field of human-computer interaction, can solve problems such as failure

Active Publication Date: 2020-11-27
SOUTH CHINA UNIV OF TECH
View PDF5 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This detection method fails if the hand is occluded, or if the hand is too far away

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Movable gesture interaction device and method capable of being used for augmented reality game
  • Movable gesture interaction device and method capable of being used for augmented reality game
  • Movable gesture interaction device and method capable of being used for augmented reality game

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0059] A mobile gesture interaction device that can be used in augmented reality games, such as figure 1 As shown, gesture sensor 1, raspberry pie 2 and augmented reality glasses 3 are included; wherein, the gesture sensor 1 and raspberry pie 2 are installed on the augmented reality glasses through a support structure, and the data interface of gesture sensor 1 is connected via USB The data line is connected with the USB interface on the Raspberry Pi 2, and the captured gesture data is transmitted to the Raspberry Pi 2; the Raspberry Pi 2 sends the gesture data to the PC terminal 4 through the 5G wireless connection of the WiFi router 5, so The augmented reality glasses receive the gesture data processed by the PC terminal 4 through the 5G wireless connection of the WiFi router 5, and construct a virtual hand model to interact with the virtual game world according to the processed gesture data. The fast transmission characteristics of 5G meet the real-time requirements of augm...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a movable gesture interaction device and method capable of being used for an augmented reality game. The method specifically comprises the following steps that firstly, a gesture sensor and a raspberry pi are installed on augmented reality glasses, the data of the gesture sensor are read out through the raspberry pi and sent to a PC end, and then the coordinates of a gesture are converted into game world coordinates through the conversion relation between coordinate systems. And on the basis, the PC end processes the gesture data by using an interval Kalman filter and particle filtering, and then sends the data to the augmented reality glasses. In addition, a virtual hand model is constructed in the virtual game world by using a registration tracking technology, andthe gesture data received by the augmented reality glasses is used for driving the virtual hand model. According to the invention, a natural and visual interaction experience is provided, a player can use gesture interaction in a large-scale scene without being influenced by position and direction, and the reliability of interaction is improved.

Description

technical field [0001] The invention belongs to the field of human-computer interaction, and in particular relates to a movable gesture interaction device and method that can be used for augmented reality games. Background technique [0002] Augmented reality is a technology that subtly integrates virtual information with the real world. Augmented reality technology has received a lot of attention because it is disruptive and revolutionary. With the continuous improvement of hardware equipment, the application field of augmented reality has expanded to many new fields, such as virtual assembly, virtual teaching, remote surgery, etc. In the field of games, the immersive technology of augmented reality brings consumers a more immersive 3D experience. Gesture interaction is the most widely used interaction method in people's daily life. Many augmented reality games also use gesture interaction, such as electronic guns, wearable exoskeletons, and gesture detection sensors. Ho...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/01G06T7/277G06K9/00A63F13/213
CPCG06F3/017G06F3/011G06T7/277A63F13/213G06V40/28
Inventor 杜广龙
Owner SOUTH CHINA UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap