Novel intelligent sign language translation and man-machine interaction system and use method thereof

Abstract

The invention provides a novel intelligent sign language translation and man-machine interaction system which comprises a gesture identifying system and a semantic vocalizing system. The gesture identifying system is connected with a user with language disorder to transmit an original electromyographic signal; the gesture identifying system is connected with the semantic vocalizing system to transmit basic semantic information; and the semantic vocalizing system transmits voice which is consistent with the semantics of sign language. The gesture identifying system comprises an electromyographic signal acquisition device, a wireless transceiver, a filter, a characteristic extraction unit and a classifier. The semantic vocalizing system comprises a semantic analyzer, a voice controller and a portable speaker. According to the novel intelligent sign language translation and man-machine interaction system and the use method thereof, a mode identifying technology based on the electromyographic signal is adopted, the gesture identification precision is improved and the efficiency in exchange between the user with language disorder and an healthy person is improved by combining a voice system. After being simply adjusted, the system and the method can be used by users with language disorder with different body shapes. The electromyographic signal acquisition device and the semantic vocalizing system are respectively worn through a wrist band and a waist band, so that the normal life of the user with language disorder is not affected.

Description

Technical field [0001] The invention relates to a translation and human-computer interaction system, in particular to an auxiliary system that accurately recognizes the sign language of persons with language disabilities based on the electromyography signal pattern recognition technology and realizes online vocalization. Background technique [0002] In addition to the deaf and dumb, people with language impairments also include people with language communication barriers caused by other reasons. Take the hearing impaired as an example. There are approximately 20.75 million hearing impaired people in China, including hearing impaired, hard of hearing, and aging deaf. And sign language is a certain meaning or word constructed by simulating images or syllables based on changes in gestures. It is a hand language for people with language impairments to communicate and exchange ideas, and is the main communication tool for people with language impairments. According to statistics, in...

AI Technical Summary

Problems solved by technology

[0004] After reviewing the existing literature, it is found that most of the current sign language recognition is based on the above two technologies, but it is not feasible in practical applications, and the ability to assist people with language barriers in normal communication is still limited.

Images