Somatosensory-based natural interaction method for virtual mine

Abstract

The invention discloses a somatosensory-based natural interaction method for a virtual mine. The method comprises the steps of applying a Kinect to acquire gesture signals, depth information and bone point information of a user; carrying out smoothing filtering on images, depth information and bone information of the gesture signals; dividing gesture images by using a depth histogram, applying an eight neighborhood outline tracking algorithm to find out a gesture outline, and identifying static gestures; planning feature matching identification of dynamic gestures by improving dynamic time according to the bone information; triggering corresponding Win32 instruction information by using a gesture identification result, and transmitting the information to a virtual reality engine, respectively mapping the instruction information to the primary keyboard mouse operation of a virtual mining natural interaction system, so as to realize the somatosensory interaction control of the virtual mine. According to the method provided by the invention, the natural efficiency of man-machine interaction can be improved, and the immersion and natural infection represented by the virtual mine can be improved, and the application of the virtual reality and a somatosensory interaction technology can be effectively popularized in coal mines and other fields.

Description

technical field [0001] The invention belongs to the fields of somatosensory technology, virtual reality, natural human-computer interaction and the like, and in particular relates to natural interaction of a virtual mine based on somatosensory. Background technique [0002] In recent years, with the in-depth development of speech recognition technology, sensor technology, camera technology and computer vision technology, especially the wide application of touch screen technology, the human-computer interaction interface has gradually changed from the early command line, graphical user, mouse and keyboard interaction, etc. The transformation into the current research hotspot - Natural User Interface (Natural User Interface, NUI). [0003] Somatosensory interaction technology is the latest technology of natural Human-Computer Interface (HCI), which allows people to directly interact with the environment through body movements and manipulate the environment "as they please". T...

AI Technical Summary

Problems solved by technology

[0005] Aiming at problems such as poor naturalness, high cost of use, low efficiency, and lack of realism in existing virtual mine human-computer interaction in the prior art, the present invention provides a method that improves the natural efficiency of human-computer interaction and increases the virtual A somatosensory-based natural interaction method for a virtual mine with a sense of immersion and a natural sense of mine performance, the technical solution of the present invention is as follows: a somatosensory-based virtual mine natural interaction method, which includes the following steps:

Images