Semantic-computing-based interaction system and method for person with hearing or language disorder

Abstract

The invention relates to a semantic-computing-based interaction system and a semantic-computing-based interaction method for person with hearing or language disorder. The system is characterized by comprising two parts, namely portable terminals and a cloud-computing-based cloud server, and comprises at least two types of portable terminals, namely a first-type portable terminal and a second-type portable terminal or a portable terminal combining the two types of terminals. The portable terminals are used for performing related computing, data also can be uploaded to the cloud server for accurate computing, then a result is returned to the portable terminals, and different users can customize different semantic dictionaries. The system and the method have the advantages that words spoken by normal person are converted into the animation display of hand signs, so that the normal person can transmit information to the person with the hearing or language disorder without barriers; and the hand signs of the person with the hearing or language disorder can be converted into voices for play or into texts for display, so that interaction between the normal person and the person with the hearing or language disorder is further facilitated.

Description

technical field [0001] The invention relates to a communication system and method for persons with hearing or speech impairments, in particular to a communication system and method for persons with hearing or speech impairments based on semantic computing. Background technique [0002] People with hearing or language impairments can't hear or speak, and can't communicate like normal people, which makes their living conditions very chaotic in terms of work, study, entertainment, medical treatment, and rights protection. Therefore, strengthening communication between normal people and people with hearing or language impairments and completing education has become the key to solving the social life problems of people with hearing or language impairments. [0003] It is well known that people with hearing or speech disabilities have significant educational problems. Children with hearing or speech disabilities are less likely to be enrolled in compulsory education. People w...

AI Technical Summary

Problems solved by technology

[0004] The present invention mainly solves the technical problems existing in the prior art, such as the low level of education and communication difficulties for hearing or language-impaired persons in the society; it provides an image display that converts words spoken by normal people into sign language, and realizes Normal people can convey information to hearing or language-impaired people without barriers, and can realize the sign language playback of hearing or language-impaired people, which further facilitates the communication between normal people and hearing or language-impaired people. Semantic computing-based hearing or language Communication system and method for persons with disabilities

Images