Sign language voice conversion method and device

A voice conversion and sign language technology, applied in the field of sign language translation, can solve the problems of inconvenient communication for the deaf, and achieve the effect of low hardware requirements and easy implementation

Active Publication Date: 2015-12-02
王超
View PDF6 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] Due to the vast territory of our country, there are many local sign languages, which brings inconvenience to the communication between deaf people

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Sign language voice conversion method and device
  • Sign language voice conversion method and device
  • Sign language voice conversion method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0024] Embodiment one: if figure 1 , figure 2 As shown, a sign language speech conversion device includes a display 1, a wristband, a finger ring and a controller. The finger ring includes a left finger ring 4 and a right finger ring 5, and the wrist ring includes a left hand ring 2 and a right hand ring 3. The display shows the phonetic symbols expressed by the sign language person (deaf-mute), and displays the words converted from the voice person's utterance to the sign language person. For the convenience of the sign language person to watch, the display selects a head-mounted display including a spectacle frame and a small display screen, and the controller is installed on one side of the spectacle frame. This type of display has been successfully developed by many companies, such as Google Glass produced by Google.

[0025] The distance detector is used to detect the distance from the finger to the wrist and the distance from the finger to the display screen when the ...

Embodiment 2

[0031] Embodiment 2: Based on the sign language speech conversion device described in Embodiment 1, the present invention also provides a sign language speech conversion method, by which not only the conversion from sign language to speech by the sign language user can be realized, but also the speech spoken by the speaker Speech is converted into text and displayed to sign language speakers, realizing normal communication from sign language speakers to voice speakers.

[0032] Such as Figure 1 to Figure 3 As shown, when the sign language person uses the device, the ring is worn on the tip of the finger, the wristband is worn on the wrist, and the head-mounted display is worn.

[0033] Since each person's arm length and palm length are different, there is also an initialization process before using the device for the first time: after turning on the system switch, press the shift button and the selection button at the same time for 10 seconds, the display screen instructs the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a sign language voice conversion device, comprising a display, a bracelet, finger rings and a controller; a microphone for receiving voice and a voice character translation chip for converting a voice into characters are arranged in the display; the bracelet is provided with a loudspeaker; when a sign language person expresses, the controller receives a distance value detected by a distance detector, matches a preset sign language action value in a database with corresponding pinyin syllables, and then controls the loudspeaker to sound; when a sounder expresses, the controller controls the display to display character information converted by the language character translation chip. The sign language voice conversion device based on a binary syllabification sign language, combined with an electromagnetic recognition technology, precisely detects a distance among wrists, fingers and a human body and realizes accurate conversion from the sign language to voice; the whole device has low requirements on hardware, and suitable for production and popularization; data can be established relatively easily without containing thousands of complex sign language actions and are easy to realize.

Description

technical field [0001] The invention belongs to the field of sign language translation, in particular to a sign language-to-speech conversion device and method. Background technique [0002] According to statistics, there are 20.57 million deaf people in my country, and sign language is the main tool for them to express their thoughts and communicate. Sign language is the most familiar thing for deaf people, but for ordinary people, it is more like a foreign language. In China, such as Shanghai, the number of people who can sign language does not exceed 10,000, and the penetration rate is less than one in a thousand. The low penetration rate of sign language has greatly hindered the effective communication between the hearing-impaired and the able-bodied. Therefore, it is very necessary to design a tool that allows the deaf-mute to communicate with ordinary people. [0003] Due to the vast territory of our country, there are many local sign languages, which brings inconve...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G09B21/00G06F3/01G06F3/16
Inventor 王超
Owner 王超
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap