Man-machine interaction method based on human body gesture recognition

Abstract

The invention relates to a man-machine interaction method based on human body gesture recognition. Arm movement and finger movement in a user behavior process are collected through a KINECT device, collected images are subjected to operation processing, the processed images are recognized, and operation control is conducted after recognition; when the arm movement is recognized, image collection is conducted through the KINECT device, skeleton image data of a human body is obtained, mapping from a real person to a virtual person is conducted, the obtained data is processed to obtain behavior of elbows and palms, and corresponding movement is recognized through calculation and analysis to execute control operation; when the finger movement is recognized, a deep image is obtained through the KINECT device, the position of a hand is obtained according to palm coordinates, an appropriate palm area is captured, the palm deep image is processed to obtain HU invariant moment of a finger image, and control operation is executed after the HU invariant moment is matched with a standard gesture. Seamless man-machine interaction is achieved, and new experience is brought to users.

Description

technical field [0001] The invention relates to the technical field of intelligent recognition, in particular to a human-computer interaction method based on human gesture recognition. Background technique [0002] With the development of computer vision technology and people's demand for new means of interaction, interactive methods based on computer vision have gradually developed. Traditional interaction methods such as mouse, keyboard, handle, etc. have been unable to play a convenient role in some special fields. The system of non-contact control through human gesture recognition completely gets rid of the dependence on mouse and remote control, etc. Very good application prospects. [0003] The traditional human-computer interaction method is relatively deterministic during use, such as pressing a keyboard button or clicking the left and right buttons of the mouse, the computer will associate this with a certain system event, and the process is generally not affected ...

AI Technical Summary

Problems solved by technology

[0004] The technical problem to be solved by the present invention is to provide a human-computer interaction method based on human gesture recognition to solve the limitations of traditional human-computer interaction relying on mouse and remote control, realize more seamless human-computer interaction, and bring new experience, it is more convenient to complete computer operation or device control

Images