A synthesis method of sign language animation

A synthesis method and sign language technology, applied in the field of human-computer interaction, can solve problems such as lack of realism and extraction

Inactive Publication Date: 2018-06-22
BEIJING UNIV OF TECH
View PDF2 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] However, since text or speech can only provide limited basic information, the current natural language processing technology cannot extract rhythm, expression and other factors that can enhance the intelligibility of sign language expressions from text, so text-driven sign language animation synthesis is often real Therefore, more and more researchers are trying new methods to achieve more realistic sign language animation synthesis

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A synthesis method of sign language animation
  • A synthesis method of sign language animation
  • A synthesis method of sign language animation

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0013] The synthesis method of the sign language animation can acquire the expression information in the sign language expression in a more intuitive and accurate manner, and synthesize a more realistic sign language animation.

[0014] Technical solution of the present invention is: the synthetic method of this sign language animation, comprises the following steps:

[0015] (1) Generate video-driven 3D facial expressions;

[0016] (2) Generate text-driven three-dimensional gestures to obtain gesture action sequences;

[0017] (3) Coordinate facial expression sequence and gesture sequence.

[0018] The present invention generates video-driven three-dimensional human facial expressions, generates text-driven three-dimensional gestures, obtains gesture action sequences, and coordinates facial expression sequences and gesture action sequences, thereby obtaining expression information in sign language expressions in a more intuitive and accurate manner. Synthesize more realisti...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a sign language animation synthesis method. By means of the method, expression information in sign language expressions can be obtained more visually and accurately, and more real sign language animations are synthesized. The sign language animation synthesis method includes the first step of generating three-dimensional facial expressions driven by videos, the second step of generating three-dimensional gestures driven by text to obtain a gesture movement sequence, and the third step of coordinating a facial expression sequence and the gesture movement sequence.

Description

technical field [0001] The invention belongs to the technical field of human-computer interaction, and in particular relates to a synthesis method of sign language animation. Background technique [0002] Sign language is a relatively stable expression system composed of gestures supplemented by expressions and gestures. It is a multi-mode collaborative language that relies on action / visual communication. The field has a wide range of applications, therefore, the study of sign language synthesis method has important research and social significance. Sign language synthesis technology involves many disciplines such as natural language processing, computer animation, and pattern recognition. At present, it mainly focuses on the following three aspects of research: the analysis and processing from text to sign language, the realization method of computer-synthesized sign language, and the expression of synthetic sign language. [0003] According to different input types, sign ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06T19/00
Inventor 尹宝才高明王立春孔德慧
Owner BEIJING UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap