Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Convolutional neural network-based human hand image region detection method

A convolutional neural network, image area technology, applied in graphics reading, input/output process of data processing, input/output of user/computer interaction, etc. occlusion and other issues

Active Publication Date: 2016-11-16
INST OF SOFTWARE - CHINESE ACAD OF SCI
View PDF4 Cites 18 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The traditional convolutional neural network has strong discrimination in the field of object recognition, but it requires the input to be invariant to rotation. In many tasks, such as human hand image area detection, the input image has a large number of rotation changes. The traditional convolution Neural networks perform poorly on these tasks
In addition, in the traditional detection method, the candidate region extraction is completely based on the gray value Unicom region, which is difficult to deal with objects such as hands with large deformation and serious occlusion.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Convolutional neural network-based human hand image region detection method
  • Convolutional neural network-based human hand image region detection method
  • Convolutional neural network-based human hand image region detection method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0017] In order to make the above objects, features and advantages of the present invention more obvious and understandable, the present invention will be further described below through specific embodiments and accompanying drawings.

[0018] S1. The present invention provides a method for detecting regions of hand images based on convolutional neural networks, its overall framework and process are as follows figure 1 As shown, the method includes the following steps:

[0019] Step 1: Collect multiple training images, mark the positions of the wrist and palm center on the training images, and calculate the angle of the human hand, and divide the training set into multiple angle sets according to the marked angle information. Taking each angle set as a training subset, train a multi-component sliding window classification model M1.

[0020] Step 2, based on the classification model M1, extract candidate regions P1 for each image in the training set, and label the candidate re...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a convolutional neural network-based human hand image region detection method. The method comprises the following steps of: carrying out feature extraction on an image by utilizing a convolutional neural network, and training a weak classifier; for the image, angles of which are marked, segmenting the image on the basis of the classifier to obtain a plurality of candidate regions; modeling each candidate region by utilizing the convolutional neural network so as to obtain an angle estimation model, and carrying out angle marking to rotate the candidate area to a positive definite attitude; modeling each candidate region again by utilizing the convolutional neural network so as to obtain a classification model; for a test image, firstly segmenting the test image by using the weak classifier so as to obtain candidate regions, and for each candidate region, estimating angle of the candidate region through the angle estimation model and rotating the candidate region to a positive definite attitude; and inputting the candidate region under the positive definite attitude into the classification model to obtain a position and an angle of a human hand in the image. According to the method, the classification precision is improved by adopting convolutional neural network-based coding classification, and by utilizing the angle model, the method has rotation variance and very high human hand region detection precision.

Description

technical field [0001] The invention belongs to the fields of pattern recognition and computer vision, and in particular relates to a method for detecting regions of hand images based on convolutional neural networks. Background technique [0002] In recent years, with the development of computer vision and pattern recognition, the detection and positioning of hands has made significant progress, but there are still many deficiencies. Due to the influence of the external environment, such as illumination changes, hand shadows, hand deformation, hand Self-occlusion, mutual occlusion, etc. of hand movement have brought great challenges to hand detection and positioning. Convolutional Neural Networks (CNN) is a type of artificial neural network. Its weight sharing network structure makes it more similar to biological neural networks, which reduces the complexity of the network model and the number of weights. It has achieved the best results in almost all current object classi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06K9/00G06K9/62G06F3/01
CPCG06F3/017G06V40/28G06V40/107G06F18/217
Inventor 邓小明袁野杨硕王宏安
Owner INST OF SOFTWARE - CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products