Hand key point detection method, gesture recognition method and related devices

Abstract

The embodiments of the invention disclose a hand key point detection method, a gesture recognition method and related devices. The hand key point detection method comprises the steps of: acquiring a hand image; inputting the hand image into a pre-trained thermodynamic diagram model to obtain a thermodynamic diagram of hand key points; inputting the thermodynamic diagram and the hand image into a pre-trained three-dimensional information prediction model to obtain hand structured connection information; and determining three-dimensional coordinates of the hand key points in the world coordinatesystem according to the hand structured connection information and two-dimensional coordinates in the thermodynamic diagram. According to the embodiments of the invention, the two-dimensional coordinates and the hand structured connection information are successively predicted through the two models so as to calculate the three-dimensional coordinates of the hand key points relative to the three-dimensional coordinates returned directly through a deep neural network; the calculation amount of each model is small; the method is suitable for the mobile terminal with the limited calculation capacity; due to the small calculation amount and the short detection time of the hand key points, the hand key points are detected in real time, and gesture recognition can be easily applied to the mobile terminal.

Description

technical field [0001] The embodiments of the present invention relate to the technical field of computer vision, and in particular to a hand key point detection method, a hand key point detection device, a gesture recognition method, a gesture recognition device, a device, and a storage medium. Background technique [0002] In the field of computer vision, gesture recognition is widely used in human-computer interaction, sign language recognition and other scenarios, while gesture recognition relies on key point detection of hands, and with the popularization of mobile terminals and mobile Internet, gesture recognition is also widely used in in the mobile terminal. [0003] The key points of the hand refer to each joint point in the hand. The most commonly used method for detecting the key points of the hand in the prior art is to use a deep convolutional neural network to output the three-dimensional coordinates of the key points of the hand through the deep convolutional ...

AI Technical Summary

Problems solved by technology

[0004] Embodiments of the present invention provide a hand key point detection method, a hand key point detection device, a gesture recognition method, a gesture recognition device, a device, and a storage medium, so as to solve problems existing after the existing hand key point detection method is applied to a mobile terminal. Long calculation time and poor real-time performance limit the application of gesture recognition in mobile terminals

Images