62 results about "Fingertip detection" patented technology

The invention discloses a first view fingertip detection method based on a convolutional neural network and a heat map, which includes the following steps: collecting a gesture image, marking the position of the bounding rectangle of the gesture and the coordinates of the fingertip, and cutting the original gesture image and updating the fingertip position through the bounding rectangle to generate a fingertip heat map; designing a gesture detection convolutional neural network, extracting gesture features, and training the network using the image before cutting and the bounding rectangle to make the network converge; designing a fingertip heat map regression convolutional neural network, extracting fingertip features, and training the network using the image after cutting and the heat mapto make the network converge; and segmenting an input first view video into frames, using the trained gesture detection convolutional neural network to get the bounding rectangle of the gesture, cutting out the gesture part and inputting the gesture part to the fingertip heat map regression convolutional neural network to predict the heat map of the fingertip, and getting the coordinates of the fingertip according to the heat map. The position of the fingertip can be accurately detected in complex backgrounds and under different light conditions.