Gesture interaction system based on computer visions

Abstract

The invention relates to a gesture interaction system based on computer visions. The gesture interaction system comprises a video collection module, an image processing module, an identification and positioning module, and an interaction design module, wherein the video collection module is used for collecting the video images of a hand by a camera in a real-time way, the image processing module is used for processing the video information through a Gaussian filtration method, a binaryzation method and the like and obtaining hand contours as binary image for identification and tracking, the identification and positioning module is used for carrying out gesture identification on the hand contours through a PCA (principal component analysis) algorithm, and simultaneously tracking the position of a palm through a particle filtration algorithm, and the interaction design module is used for calling a mouse API (application programming interface) according to the gesture identification results and the position where the palm is located, to enable a mouse cursor to realize operation functions, such as move, left click, right double click, right click or no operation. The gesture interaction system has the advantages that the accuracy is high, the response speed is high, multiple interaction functions are realized, and the identification accuracy is high. The gesture interaction system can be used for the interaction of human-computer gestures inputted by the computer, and can also be used for other fields of system monitoring, mode identification and the like.

Description

technical field [0001] The invention relates to a human-computer interaction system, in particular to a gesture interaction system based on computer vision, and belongs to the field of information technology. Background technique [0002] People have been using traditional interactive devices, such as keyboards and mice, for human-computer interaction with computers since the last century, but some traditional interactive devices can no longer play a convenient role in special fields. [0003] In recent years, with the development of hardware and people's continuous innovation, more and more human-computer interaction technologies have emerged. The purpose of these human-computer interaction technologies is to solve the intelligence and usability of computers, and most of the research directions of various human-computer interaction technologies revolve around improving the practicality and comfort of human-computer interaction technologies, so that users can simply and natu...

AI Technical Summary

Problems solved by technology

The disadvantage of this technology is that the types of computer commands that can be realized through facial movements (such as blinking) are limited, that is, there are few interactive functions, and the recognition accuracy is low.

Images