Hand area segmentation method deeply integrating significance detection and prior knowledge

Abstract

The invention relates to a hand area segmentation method deeply integrating significance detection and prior knowledge. This method combines the significant pattern of a hand area at pixel level with the significant pattern of a hand area at the regional level to make the detection algorithm for the entire hand area achieve higher robustness and accuracy. The method comprises the following steps: using an introduced Bayesian framework to obtain the confidence degree of each pixel in the hand area; combining the relevant techniques such as threshold segmentation, and finally obtaining a hand area segmentation result with high accuracy. The invention overcomes the shortcomings of a traditional hand area method which can only be applied to relatively simple background and non-near-skin color interference scene, and the method can obtain a hand area segmentation image accurately even in the case of various disturbances such as non-uniform illumination, near skin color background and face noise, therefore, making it applied with great prospects.

Description

technical field [0001] The invention relates to a hand region segmentation method that deeply integrates saliency detection and prior knowledge, and belongs to the technical fields of computer vision, image processing, pattern recognition and other fields Background technique [0002] Vision-based gesture recognition refers to the use of various cameras to continuously collect the shape and displacement of the hand to form a sequence frame of model information, and then convert them into corresponding instructions to control certain operations. This technology has been widely used in many scenarios such as human-computer interaction, robot control and virtual reality. Common gesture recognition technologies usually involve hand region segmentation, hand shape feature extraction, hand tracking and gesture recognition. Among them, the hand area segmentation technology is to eliminate the interference of other elements in the picture, accurately segment the human hand area, an...

AI Technical Summary

Problems solved by technology

For example, in the article "Research on Gesture Interaction Technology for Home Service Robots" by Yang Wenji, multi-scale color contrast and texture contrast are used to obtain the saliency map of the image, and then the saliency map is combined with the skin color probability map and object property measurement. fusion of empirical knowledge and threshold segmentation to obtain the final hand region detection result. This method has a very high segmentation accuracy in a relatively simple background, but due to over-consideration of the region-level contrast, resulting in its incomplex background. In the article "Saliency-guided improvement for hand posture detection and recognition", Chuang Yuelong proposed a saliency detection method that does not combine any prior information, which is mainly used for rough positioning of the hand, and then The obtained saliency map is fused with the skin color probability map to obtain hand area estimation. This method can eliminate the interference of large areas of close-skinned background, but it lacks the ability to exclude faces that are also more prominent areas and are near-skinned.

In short, compared with the traditional methods, the existing series of schemes that introduce saliency detection into the scene of hand region segmentation have greatly improved the accuracy and the ability to overcome some background interference, but because most of them are The saliency detection and the detection based on prior knowledge such as skin color are carried out separately, and finally fused, which makes the robustness of the algorithm poor, and it is difficult to completely overcome the interference of faces and other complex backgrounds, and it is still unable to be used in actual scenes. use in

[0005] In short, the traditional hand region segmentation method has a single technical method and relies too much on skin color detection technology. When there are interference factors such as uneven illumination and uneven illumination, these methods are almost unable to achieve accurate hand region segmentation.

Existing hand region detection methods fail to make full use of prior knowledge, and have relatively large defects in the ability to overcome complex background interference, especially near-skin background interference

Images