Surface myoelectrical signal based sign language recognition vocal system and method

Abstract

The invention provides a surface myoelectrical signal based sign language recognition vocal system and method. The system includes a myoelectricity acquisition unit, an inertial measurement unit, a processor unit, and a speech synthesis unit; the myoelectricity acquisition unit is arranged an arm muscle of a subject; the inertial measurement unit is arranged on a wrist of the subject; an output end of the myoelectricity acquisition unit and an output end of the inertial measurement unit are connected to an input end of the processor unit; and an output end of the processor unit is connected to an input end of the speech synthesis unit. The method includes: acquiring an myoelectrical signal of an arm of the subject and an acceleration signal of the wrist of the subject; extracting a characteristic value of the myoelectrical signal and a characteristic value of the acceleration signal; matching the characteristic value of the myoelectrical signal, the characteristic value of the acceleration signal, and a matching model base of each sign language action; outputting the matched sign language actions in a text form; converting the text form of the sign language actions into voice; and outputting the voice of the sign language actions.

Description

technical field [0001] The invention belongs to the technical field of digital signal processing and service robots, and in particular relates to a sign language recognition and vocalization system and method based on surface electromyography signals. Background technique [0002] Sign language is the language used by people with deaf disabilities. It uses gestures to compare actions, and simulates images or syllables according to gesture changes to form certain meanings or words. It is a special language that communicates by actions and vision. However, sign language is a huge and complex language system, and it is obviously unrealistic for most normal people to master and use sign language to communicate directly with deaf-mute disabled people. At present, the communication between the deaf-mute and normal people is only limited to normal people who understand sign language as interpreters, which largely limits the scope of communication between the deaf-mute The compreh...

AI Technical Summary

Problems solved by technology

However, sign language is a huge and complex language system, and it is obviously unrealistic for most normal people to master and apply sign language to communicate directly with deaf-mute disabled people

At present, the communication between the deaf-mute and normal people is only limited to normal people who understand sign language as interpreters, which largely limits the scope of communication between the deaf-mute The comprehensive understanding expressed by people brings great inconvenience to the daily life, work and study of the deaf-mute disabled

Images