Multi-feature Fusion Sign Language Recognition Method Based on Adaptive Hidden Markov

A Hidden Markov, adaptive technology, applied in the field of computer vision, which can solve problems such as high overhead and reduced effect

Active Publication Date: 2020-07-10
HEFEI UNIV OF TECH
View PDF2 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Back-end score fusion usually takes too much time, and in different models, features with poor effects may dominate feature fusion, reducing the effect of fusion

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-feature Fusion Sign Language Recognition Method Based on Adaptive Hidden Markov
  • Multi-feature Fusion Sign Language Recognition Method Based on Adaptive Hidden Markov
  • Multi-feature Fusion Sign Language Recognition Method Based on Adaptive Hidden Markov

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0060] In this example, if figure 1 As shown, a multi-feature fusion sign language recognition method based on adaptive hidden Markov, this method uses Gaussian mixture-hidden Markov model GMM-HMM, firstly extracts multiple features from the sign language video database and performs front-end fusion, namely Construct a feature pool set; then build an adaptive hidden Markov model for each sign language video under different features in the feature pool set, and propose a feature selection strategy to obtain a suitable back-end score fusion feature; choose a good back-end After the score fusion feature, the score vector under each back-end score fusion feature is calculated, and different weights are assigned to it, and then the back-end score fusion is performed to obtain the optimal fusion effect. Specifically, if figure 1 shown, including the following steps:

[0061] Step 1, obtain the sign language video database, and divide the sign language video in the sign language vi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a multi-feature fusion sign language recognition method based on adaptive hidden Markov, which includes: 1. Firstly, multiple features are extracted from the sign language video database and the front-end fusion is performed, that is, a feature pool set is constructed; and then each sign language video is constructed. An adaptive hidden Markov model under different features in the feature pool set, and a feature selection strategy is proposed to obtain a suitable back-end score fusion feature; after selecting the back-end score fusion feature, calculate each back-end score The score vector under the fusion feature is assigned different weights, and then the back-end score fusion is performed to obtain the optimal fusion effect. The invention can realize the accurate identification of sign language video sign language category and improve the robustness of identification.

Description

technical field [0001] The invention belongs to the technical field of computer vision, relates to technologies such as pattern recognition and artificial intelligence, and specifically relates to a multi-feature fusion sign language recognition method based on adaptive hidden Markov. [0002] technical background [0003] Deaf people are a large group of disabled people, because they cannot speak, deaf people usually use sign language as a means of communication. When normal people who have not learned sign language need to communicate with deaf people, communication barriers arise, and most normal people in society have not received sign language education. Therefore, the sign language interpretation system is of great significance to the deaf-mute as an auxiliary way to facilitate the integration of the deaf-mute into the society. But at present, sign language translation is still a difficult problem in the field of computer vision. The reason is that there are many facto...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06K9/00G06K9/62
CPCG06V40/28G06V20/41G06F18/23G06F18/253
Inventor 郭丹宋培培赵烨汪萌
Owner HEFEI UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap