Self-learning hand tracking device and method based on skin color model

Abstract

Provided are a device and a method self-learning skin-color model based hand portion tracking. The device of self-learning skin-color model based hand portion tracking comprises a preprocessing unit which is used for extracting a hand candidate area from an image in a frame and obtaining an initial hand area HINIT through a morphologic detection, a self-learning unit which is used for self-learning using the hand waiting area and the initial hand area HINIT to obtain a hand area HFINAL after self-learning of the frame, and a subsequent processing unit which is used for processing the hand area HFINAL after original frame self-learning to obtain a hand outline and finger tip positions. The self-learning unit comprises a hand tracker, a hand recognizer and a P-N learning device. The self-learning skin-color model based hand portion tracking method includes a preprocessing step, self-learning and P-N classifying steps and a subsequent processing step. The self-learning and P-N sorting step includes a hand tracking step, a hand recognizing step and a P-N learning and sorting classifying step. According to the device and the method of self-learning skin-color model based hand portion tracking, robustness is good and hand tracking is stable and accurate when a hand passes through heavy interference areas such as a face or when a hand is sheltered.

Description

technical field [0001] The invention relates to gesture recognition and hand tracking in the field of human-computer interaction, in particular to a self-learning hand tracking device and method based on a skin color model. Background technique [0002] With the development of computer technology, human-computer interaction technology is also undergoing tremendous changes. People hope to communicate and interact with computers more and more conveniently. At present, in the field of human-computer interaction technology, the relative maturity of multimedia technology has greatly improved the ability of computer information presentation, but it also shows a serious shortage of interactive input means, showing a serious disconnect between human and computer input and output communication bandwidth. The research on multi-channel human-computer interaction technology breaks the routine, breaks through the limitations of traditional interactive devices, such as mouse, keyboard, re...

AI Technical Summary

Problems solved by technology

[0006] Aiming at the defect that the existing hand tracking method is applied to the field of human-computer interaction based on vision, the tracking effect is easily disturbed and unstable, and the probability of tracking loss is high under the interference of other moving objects and the hand is occluded. A self-learning skin color model-based hand tracking device and method

Images