Real-time gesture recognition method and device and human-computer interaction system

Abstract

The invention provides a real-time gesture recognition method and device, a mobile terminal and a human-computer interaction system, and relates to the technical field of gesture recognition, and themethod comprises the steps: obtaining gesture data which comprises sensor data collected by a data glove; preprocessing the gesture data, and performing feature extraction on the preprocessed gesturedata; and inputting the feature extraction result into a pre-trained hierarchical gesture recognition model for multi-stage gesture recognition, and determining gesture type information. Gesture dataof a user are collected in real time through the data glove, effective gesture segmentation and other preprocessing operations are carried out on the gesture data, feature extraction is carried out byconstructing a valuable feature information set, and extracted feature information is input into the lightweight hierarchical gesture recognition model to carry out gesture recognition; on the basisof ensuring gesture recognition accuracy, less system resources are occupied, and the gesture recognition method and device are suitable for mobile terminal-oriented application scenarios.

Description

technical field [0001] The present invention relates to the technical field of gesture recognition, in particular to a real-time gesture recognition method, device and human-computer interaction system. Background technique [0002] In recent years, with the popularization of computers and the rapid development of related disciplines, Human-Computer Interaction (HCI) technology has gradually become a hot research direction. Among many human-computer interaction methods, compared with traditional mechanical devices such as keyboard and mouse, gesture interaction is a more natural and human-computer interaction method that is more in line with human habits. Using gestures instead of keyboards and mice as input to control computers can make the interaction between humans and machines more natural and flexible, and can directly apply the experience people have gained in daily life to interactive activities. Therefore, gesture recognition technology, as an important branch in th...

AI Technical Summary

Problems solved by technology

[0004] However, there are still many problems in vision-based gesture recognition. For example, because the hand is a multi-joint non-rigid object, it deforms greatly under different viewing angles and different actions, and it is easy to cause occlusion during two-dimensional projection, resulting in information loss; and due to Due to the limitations of current computer vision technology, gesture extraction in complex backgrounds has always been difficult, thus limiting the wide-scale application of vision-based gesture recognition

The existing vision-based gesture recognition methods will also be affected by factors such as bad weather and irregular sensor wearing, which will reduce the accuracy of gesture recognition and affect the effect of gesture detection

Images