Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

An automatic generation system for character Chinese lip animation

A technology of automatic generation and mouth shape, applied in the computer field, to achieve the effect of improving efficiency and high practicability

Inactive Publication Date: 2011-12-07
INST OF AUTOMATION CHINESE ACAD OF SCI
View PDF0 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In the existing system, these two modules are only loosely coupled (speech segmentation is performed on the audio separately, and then the result of the segmentation is used to guide and set the key frame position of the animation mouth shape), and there are almost few differences between the two parts. Interaction, so it is difficult to automatically complete the adjustment of the pronunciation position and the arrangement of the animated mouth shape according to the character's dialogue voice intensity and length characteristics

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • An automatic generation system for character Chinese lip animation
  • An automatic generation system for character Chinese lip animation
  • An automatic generation system for character Chinese lip animation

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0014] Below, in conjunction with the accompanying drawings, a systematic description will be given of how the present invention encodes the input dialogue text and audio, splits them, and forms the flow of character lip animation.

[0015] The structure of the present invention is as figure 1 shown. The basic hardware conditions required for the realization of the system are: a computer with a main frequency of 2.3GHz and a memory of 1G; the required software conditions are: animation production environment (3dmax, maya can be used), programming environment (vs.net2005 ). The system mainly includes a dialogue text filtering and coding module 1 , a dialogue voice segmentation module 2 , a dialogue segmentation coding integration module 3 and a character Chinese lip animation generation module 4 . Dialogue text filtering and encoding module 1 conducts phrase segmentation, pinyin mouth-shape encoding, overall recognition and reading mark setting and encoding filtering on the d...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a system for automatically generating animations of characters' Chinese mouth shapes. The dialogue text filtering and coding module performs phrase segmentation, pinyin mouth shape coding, overall recognition and reading mark setting and coding filtering on the dialogue text, generates and outputs dialogue mouth shape codes, and dialogue overall Recognition and reading code identification and dialogue mouth shape filter coding sequence; dialogue speech segmentation module conducts speech sampling and speech energy statistics on dialogue audio, generates and outputs dialogue speech segmentation candidate result sequence; dialogue segmentation coding integration module connects dialogue text filter coding The module and the dialogue voice segmentation module integrate and correct the dialogue voice segmentation candidate result sequence, generate and output the dialogue segmentation code sequence; the character Chinese mouth animation generation module is connected with the dialogue segmentation coding integration module, The sequence generates and outputs the character's Chinese lip animation. In the processing process of the invention, the production of the Chinese mouth animation of the whole character can be automatically completed without loading the corresponding voice library.

Description

technical field [0001] The invention belongs to the field of computers and relates to natural language processing, speech segmentation, computer character mouth animation and other application technologies, and specifically aims at the production of 3D character Chinese mouth animation, and proposes an automatic generation system for character Chinese mouth animation. Background technique [0002] Making realistic and accurate 3D lip animation is a research hotspot in the field of computer vision and computer animation. In the production of 3D character animation, lip animation has always been a relatively time-consuming task in the production process, requiring animators to match the lip shape with the dialogue bit by bit. [0003] At present, foreign lip animation systems such as Poser lip Mimic, 3ds max lip plug-in Voice-O-Matic, etc., are mainly designed for English, and do not support Chinese or the support effect is relatively poor; while some domestic lip animation sy...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06T13/00
Inventor 于海涛吴峰风杨一平张之益葛水英李朋臧亚男
Owner INST OF AUTOMATION CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products