Eureka AIR delivers breakthrough ideas for toughest innovation challenges, trusted by R&D personnel around the world.

System and method of interaction-type foreign-language mouth shape and tongue shape simultaneous-correction

An interactive, mouth-shaped technology, applied in speech analysis, speech recognition, character and pattern recognition, etc., can solve the problems of low training efficiency, inaccurate facial recognition, and low accuracy requirements, so as to stimulate learning interest and correct the effect Good, the effect of improving accuracy

Active Publication Date: 2018-05-15
河南工学院
View PDF7 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Although users can use this system / method to understand their own mouth shape and pronunciation, there are still the following problems: ①Users can only compare with standard images, lack of interactivity, and cannot put forward additional demonstration requirements for their own special problems
There is also no way to compare with other learners, which is not conducive to stimulating learning motivation
② Facial recognition is not accurate
First of all, the existing identification requirements do not require high accuracy, so there is no incentive in this field to excessively increase the cost and improve the accuracy
Secondly, the video or image captured by the camera is two-dimensional information, and the human face, especially near the mouth, has rich three-dimensional information. Losing this information will lead to inaccurate mouth shape recognition
③Existing systems are all viewed and used on computers, TVs or other relatively fixed, large-sized, and powerful devices with strong processing capabilities. The use occasions are fixed and inconvenient to use. Unable to achieve high-precision facial information collection
⑤The method of segmenting the voice signal and then finding the corresponding image signal for comparison is complex and depends on the accuracy of voice recognition, which will lead to inaccurate comparison results
Mouth shape is not the only problem of inaccurate pronunciation. The reason for inaccurate pronunciation lies in the double influence of mouth shape and tongue shape. The existing technology does not realize the distinction between the two, so the training efficiency is low

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • System and method of interaction-type foreign-language mouth shape and tongue shape simultaneous-correction
  • System and method of interaction-type foreign-language mouth shape and tongue shape simultaneous-correction
  • System and method of interaction-type foreign-language mouth shape and tongue shape simultaneous-correction

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0049] The working principle of foreign language mouth and tongue correction system

[0050] The foreign language mouth and tongue shape correction system includes a server, a teacher client, and multiple student clients. The teacher can read a paragraph of text through the teacher's client, and the client generates the teacher's voice and multiple structured light images (the specific generation method will be introduced later), and according to the teacher's instruction, the client sends the text to the designated multiple student clients, And send the text, voice and structured light image to the server. After the student client receives the text, it presents it on the screen or projection. Students click on the text to start reading, and at the same time, the student client generates the student's voice and multiple structured light images, and sends the voice and structured light images to the server. The server models the teacher's structured light image and the stud...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a system and a method of interaction-type foreign-language mouth shape and tongue shape simultaneous-correction. Structured light is utilized for facial mouth shape recognition of users, mouth shape, speech and text information of a teacher and students is compared and analyzed on a server, and thus mouth shape problems in a foreign-language reading process are found. According to the method, a reading mouth shape and tongue shape correction process is enabled to more have pertinence in foreign-language learning through multiple modes of ''counselling'', ''following reading'', ''repeating'', ''tongue shape correction'' and the like, interaction among the multiple users is better, and mouth shape and tongue shape correction can be more accurately and effectively carried out.

Description

technical field [0001] The invention belongs to the field of intelligent recognition, in particular to the field of simultaneous recognition of mouth shape and tongue shape by using structured light. Background technique [0002] Mouth-shape problems lead to incorrect pronunciation has always been a problem that plagues foreign language speakers. Many methods have been explored in the prior art to solve this problem. For example: watch a standard pronunciation video and improve it against the mouth movements demonstrated by the characters in the video. But this method is not interactive, and users cannot measure whether their mouth is correct. In order to solve this problem, in the prior art, there is also a method of collecting user's facial features, and comparing the user's facial features with standard facial features in video or images, so as to find out the gap. In particular, some technologies also segment the pronunciation, extract the pronunciation of a certain u...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G10L15/25
CPCG10L15/25G06V40/172
Inventor 申磊李佩珊段珂仝露华付余佩
Owner 河南工学院
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Eureka Blog
Learn More
PatSnap group products