Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Pronunciation method of three-dimensional visual Chinese mandarin pronunciation dictionary with pronunciation being rich in emotion expression ability

A mandarin, emotional technology, applied in the direction of image data processing, animation production, instruments, etc.

Inactive Publication Date: 2013-08-21
UNIV OF SCI & TECH OF CHINA
View PDF3 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] At present, the study of visual pronunciation dictionaries has made gratifying progress in the following aspects, but it is also facing great challenges, which is also the starting point of this invention's research

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Pronunciation method of three-dimensional visual Chinese mandarin pronunciation dictionary with pronunciation being rich in emotion expression ability
  • Pronunciation method of three-dimensional visual Chinese mandarin pronunciation dictionary with pronunciation being rich in emotion expression ability
  • Pronunciation method of three-dimensional visual Chinese mandarin pronunciation dictionary with pronunciation being rich in emotion expression ability

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0042] The present invention will be further described below in conjunction with the accompanying drawings and specific embodiments.

[0043] 1. System framework

[0044] Emotional expression plays an extremely important role in face-to-face communication between people. Similarly, in language teaching, in order to improve the enthusiasm and effectiveness of learning, emotional synthesis should be added to the production of visual pronunciation dictionaries. However, current research ignores this point.

[0045] In view of this, this paper aims at the field of intelligent assisted language teaching, and constructs a dictionary system driven by the input of Mandarin Chinese text (with emoticon tags), speech synchronization, and used to construct 3D visual pronunciation of phonetics ( figure 1 ). When inputting Mandarin Chinese words, phrases and sentences with emoticon tags into the system, not only can the pronunciation corresponding to the input text be synthesized accordin...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a pronunciation method of a three-dimensional visual Chinese mandarin pronunciation dictionary with pronunciation being rich in emotion expression ability and relates to the technical field of voice visualization, language teaching, vocal organ animation and facial animation. The method produces the vocal organ animation and produces the facial animation with vivid expressions at the same time. The method has the advantages that based on truly-captured motion data, a physiology motion mechanism of vocal organs and a harden markov model, the built vocal organ animation has coordination and consistency related to the facial animation, and coarticulation phenomena in continuous voice animation can be completely described; data driving models are embedded into physiology models by the utilization of advantages of the physiology models and advantages of the data driving models on describing face partial detail features and reality sense aspects, and the facial animation with high reality sense is generated. An objective performance test and a subjective performance test to a system verify the effectiveness of the pronunciation method in the aspect of intelligent auxiliary language teaching.

Description

technical field [0001] The invention relates to the technical fields of voice visualization, language teaching, pronunciation organ animation, and human face animation, in particular to a pronunciation method of a three-dimensional visualized Chinese Mandarin pronunciation dictionary rich in emotional expression ability, which is a virtual three-dimensional human face model through a computer It is a technology to achieve the pronunciation of Mandarin, thereby achieving the purpose of speech visualization, teaching and entertainment. Background technique [0002] Speech visualization technology has been widely used in speech animation and serving the hearing impaired. Early work focused on the visualization of lips to understand speech, while the current work modeled a refined face model to better perceive the content of speech, mainly including three aspects of development: first, in the face model Add a 2D or 3D pronunciation organ model; secondly, collect synchronous spe...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T13/40
Inventor 於俊江辰汪增福
Owner UNIV OF SCI & TECH OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com