Method for quick-speed human-computer interaction based on finger tip tracking

Abstract

The invention discloses a method for quick human-computer interaction based on finger tip tracking, which comprises the following steps: firstly, preprocessing an image, adopting a wide-angle high-definition camera to perform high-resolution image pick-up on an indoor area, and performing image geometric distortion correction on the obtained images; secondly, extracting hand images, processing the obtained corrected images by a skin color filter, a motion filter and a color splitter, merging the results, and splitting the hand images out of the obtained corrected images; and finally, performing finger tip positioning: applying a histogram to perform rough finger tip positioning, using the rough position of a finger tip as a center to construct a searching window, and performing precise finger tip positioning through template matching. The method effectively improves the perceiving efficiency of scene images, achieves finger detection and positioning in a large range, judges the image distance between two eyes as a basis to perform the finger tip positioning without prior knowledge of the environment, and has outstanding distance robustness.

Description

technical field [0001] The invention relates to a human-computer interaction method based on fingertip tracking, belongs to the field of computer vision and video tracking, and is suitable for the human-computer interaction link in a virtual reality system. Background technique [0002] Human-computer interaction technology is one of the key technologies of virtual reality system, which realizes the interaction between human and computer, real world and virtual world. Gestures are a natural and intuitive form of human communication. Vision-based hand tracking and gesture recognition is an essential technology for realizing a new generation of human-computer interaction. [0003] In human-computer interaction, hand tracking mainly includes methods such as data gloves and visual recognition. [0004] Data glove, that is, a person can wear a sensor similar to a glove, and the computer can obtain rich information such as the position of the hand and the extension of the finger...

AI Technical Summary

Problems solved by technology

Due to the rapid development of personal smartphones and other smart devices, most of the current daily applications use hand tracking is limited to a small range, that is, the collected video does not contain other parts except the hands, which The range of motion of the user and his hands is limited, and the computer can only be operated near the camera system, which lacks flexibility and is not suitable for multi-person occasions where communication is performed while operating

Images