Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Gesture recognition method and system based on depth information

A technology of gesture recognition and depth information, which is applied in character and pattern recognition, instruments, computer components, etc., can solve the problems of complex background interference and accuracy that cannot achieve ideal interaction effects, etc.

Active Publication Date: 2019-05-24
上海易维视科技有限公司
View PDF2 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] Before the popularity of depth cameras, gesture recognition mostly used two-dimensional RGB image input, which was easily disturbed by complex backgrounds, and the accuracy could not achieve the ideal interaction effect.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Gesture recognition method and system based on depth information
  • Gesture recognition method and system based on depth information
  • Gesture recognition method and system based on depth information

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0045] Preferred embodiments of the present invention will be described in detail below in conjunction with the accompanying drawings.

[0046] In order to further understand the present invention, the preferred embodiments of the present invention are described below in conjunction with examples, but it should be understood that these descriptions are only to further illustrate the features and advantages of the present invention, rather than limiting the claims of the present invention.

[0047] The description in this part is only for several typical embodiments, and the present invention is not limited to the scope of the description of the embodiments. The mutual replacement of the same or similar prior art means and some technical features in the embodiments is also within the scope of the description and protection of the present invention.

[0048] The invention discloses a gesture recognition method based on depth information, figure 1 It is a flowchart of a gesture ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a gesture recognition method and system based on depth information, and the method comprises the steps: training a CNN model responded by a human body part, inputting an imageread by a camera, obtaining a response graph of an upper body part of a human body through the prediction of the trained model, judging the position of a hand, and segmenting a hand position image; training a CNN model based on hand joint points to realize end-to-end joint point positioning; preprocessing the segmented hand position picture, inputting the segmented hand position picture into a model for joint point position prediction, and fitting to form a gesture; clculating the distance between the position of the finger joint point and the central position of the palm, and judging the gesture matched with the position relation. According to the gesture recognition method and system based on the depth information provided by the invention, the depth information can be read in a complexscene, and interaction with the display is carried out through gesture recognition.

Description

technical field [0001] The invention belongs to the technical field of image processing and intelligent interaction, and relates to a gesture recognition method and system based on depth information. Background technique [0002] With the development of science and technology, more and more scholars pay attention to the research and application of human-computer interaction. Among them, gesture recognition, as a main branch of human-computer interaction, is one of the important research topics in the field of human-computer interaction. Gesture interaction has the advantages of convenience, strong interactivity, and rich expression content for users, and has always been the first choice of human-computer interaction. [0003] Before the popularity of depth cameras, gesture recognition mostly used two-dimensional RGB image input, which was easily disturbed by complex backgrounds, and the accuracy could not achieve the ideal interaction effect. [0004] In view of this, ther...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/62
CPCY02T10/40
Inventor 朱志林方勇
Owner 上海易维视科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products