Method and device of gesture tracking calculation based on three-dimensional model

Abstract

The invention discloses a method of gesture tracking calculation based on a three-dimensional model. The method includes: building a three-dimensional data model of a hand; inputting an image sequence, wherein a first frame image of the image sequence is lack of self occlusion and exterior occlusion, and divided according to preset color value; calculating an affine transformation matrix according to corresponding relations among outline pixel points and three-dimensional vertexes of images; obtaining class information of the three-dimensional vertexes according to the affine transformation matrix and obtaining a result after affine transformation according to the class information of the three-dimensional vertexes so as to obtain a three-dimensional hand model; and setting skeleton nodes and finger freedom degrees of the three-dimensional hand model, adding corresponding particle confinement for each skeleton nod, and obtaining a gesture outline matching picture through a particle filtering algorithm. According to the method of the gesture tracking calculation based on the three-dimensional model, a global optimization algorithm is adopted, an accurate three-dimensional initial model is needless, and tracking effects for inputted multi-view and low-resolution image or video sequences are good. The invention further discloses a device of the gesture tracking calculation based on the three-dimensional model.

Description

technical field [0001] The invention relates to the technical field of image processing, in particular to a three-dimensional model-based gesture tracking calculation method and device. Background technique [0002] Gesture recognition and tracking technology has always been an important subject of human-computer interaction. The main purpose of researching gesture recognition and tracking technology is to introduce gestures, a natural and intuitive way of communication, into the human-machine interface to achieve an interface that is more in line with human behavior habits, thereby Get the required interaction information. In recent years, with the development of science and technology, gesture recognition and tracking technology has achieved a lot of research results. Traditional gesture recognition and tracking technologies can be divided into two categories: 1) use the skin color of the hand to perform template matching and other processing methods in the two-dimensiona...

AI Technical Summary

Problems solved by technology

It is easy to fall into local extremum, and it is impossible to get very accurate results as a whole;

[0005] (3) With the increase of gestures, the misrecognition rate will also increase significantly, and the gestures cannot move too fast

Images