Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Sign language interaction method and device and computer medium

An interactive method and computer technology, applied in the field of artificial intelligence, can solve problems such as ordinary people's ignorance of sign language, achieve smooth communication and improve accuracy

Active Publication Date: 2019-12-20
TENCENT TECH (SHENZHEN) CO LTD
View PDF6 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

On the one hand, text communication is limited by conditions such as reading ability and pen and paper writing ability. On the other hand, sign language is only mastered by some deaf-mute people and very few professionals. Ordinary people do not understand sign language, and it is difficult to communicate with deaf-mute people exchange

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Sign language interaction method and device and computer medium
  • Sign language interaction method and device and computer medium
  • Sign language interaction method and device and computer medium

Examples

Experimental program
Comparison scheme
Effect test

example 1

[0151] Example 1: Communication between a deaf person and an ordinary person who does not understand sign language expression

[0152] Such as Figure 11 As shown, it specifically includes the following steps:

[0153] Step S1100, the sign language conversion device acquires the video of the deaf-mute's sign language to be recognized;

[0154] Step S1101, the sign language conversion device recognizes and acquires the semantic text expressed in the sign language video to be recognized;

[0155] Step S1102, the sign language conversion device displays the above semantic text to ordinary people;

[0156] The above-mentioned semantic text can be directly displayed to ordinary people, and the above-mentioned semantic text can also be converted into a voice signal for playback.

[0157] Step S1103, the sign language conversion device obtains the response text of ordinary people responding to the above semantic text;

[0158] The response text that ordinary people respond to can...

example 2

[0161] Example 2: Human-computer interaction between the deaf and the smart TV

[0162] Such as Figure 12 As shown, it specifically includes the following steps:

[0163] Step S1200, when the sign language interaction is triggered, the smart TV collects and sends the deaf-mute sign language video to be recognized;

[0164] Optionally, switching from the voice interaction mode or the non-interaction mode to the sign language interaction mode can be realized through the above-mentioned interaction mode switch button for switching the human-computer interaction mode in this embodiment, and the description will not be repeated here.

[0165] In step S1201, the sign language conversion device receives and recognizes the sign language video to be recognized, and determines the semantic text expressed by the sign language video to be recognized.

[0166] The method for determining the semantic text of the sign language video expression to be recognized will not be described here. ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a sign language interaction method and device and a computer medium, and relates to the technical field of artificial intelligence, for solving the problem of how to smoothly communicate with deaf-mutes. The sign language interaction method comprises the steps: obtaining a to-be-recognized sign language video; performing semantic text recognition on the to-be-recognized signlanguage video to obtain a semantic text expressed by the to-be-recognized sign language video; obtaining a response text of the semantic text; and converting the response text into a response sign language animation video taking a preset animation image as a main body. According to the sign language interaction method, the response text displayed to the deaf-mute is converted into the response sign language animation video, and the deaf-mute can know the semanteme of the response text according to the sign language of the preset animation image, so that the deaf-mute can smoothly communicatewith the deaf-mute.

Description

technical field [0001] The present application relates to the technical field of artificial intelligence, in particular to a sign language interaction method, device and computer medium. Background technique [0002] Deaf-mute people have hearing and speaking barriers when communicating with ordinary people. The traditional solution is to let deaf-mute people communicate through sign language or text, but it has certain limitations. On the one hand, text communication is limited by conditions such as reading ability and pen and paper writing ability. On the other hand, sign language is only mastered by some deaf-mute people and very few professionals. Ordinary people do not understand sign language, and it is difficult to communicate with deaf-mute people communicate. [0003] Therefore, how to communicate smoothly with the deaf-mute is a problem that needs to be considered. Contents of the invention [0004] The embodiment of the present application provides a sign lang...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06F17/27G06F16/74G06N3/08
CPCG06F16/74G06N3/084G06V40/28Y02D10/00
Inventor 陈姿
Owner TENCENT TECH (SHENZHEN) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com