A natural interaction method of virtual mine based on somatosensory

Abstract

The present invention claims a natural interaction method for a virtual mine based on somatosensory. The method includes: using the Kinect somatosensory device to obtain the user's gesture signal, depth information and skeleton point information; image preprocessing in the gesture signal, depth information and Skeleton information is smoothed and filtered; the gesture image is segmented using the depth histogram, and then the eight-neighborhood contour tracking algorithm is used to find out the gesture contour and identify the static gesture; according to the skeleton information, the feature matching and recognition of the dynamic gesture is carried out by using the improved dynamic time planning; The result of gesture recognition triggers the corresponding Win32 command message, and sends the message to the virtual reality engine, and maps the command message to the original keyboard and mouse operation of the virtual mine interaction system to realize the somatosensory interactive control of the virtual mine. The method of the invention improves the natural efficiency of human-computer interaction, and increases the immersion and naturalness of virtual mine performance. It can effectively popularize the application of virtual reality and somatosensory interaction technology in coal mines and other fields.

Description

technical field [0001] The invention belongs to the fields of somatosensory technology, virtual reality, natural human-computer interaction and the like, and in particular relates to natural interaction of a virtual mine based on somatosensory. Background technique [0002] In recent years, with the in-depth development of speech recognition technology, sensor technology, camera technology and computer vision technology, especially the wide application of touch screen technology, the human-computer interaction interface has gradually changed from the early command line, graphical user, mouse and keyboard interaction, etc. The transformation into the current research hotspot - Natural User Interface (Natural User Interface, NUI). [0003] Somatosensory interaction technology is the latest technology of natural Human-Computer Interface (HCI), which allows people to directly interact with the environment through body movements and manipulate the environment "as they please". T...

AI Technical Summary

Problems solved by technology

[0005] Aiming at problems such as poor naturalness, high cost of use, low efficiency, and lack of realism in existing virtual mine human-computer interaction in the prior art, the present invention provides a method that improves the natural efficiency of human-computer interaction and increases the virtual A somatosensory-based natural interaction method for a virtual mine with a sense of immersion and a natural sense of mine performance, the technical solution of the present invention is as follows: a somatosensory-based virtual mine natural interaction method, which includes the following steps:

Images