Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Facial animation synthesis method, a device, a storage medium, a processor and a terminal

A synthesis method, animation technology, applied in the computer field, capable of solving problems such as unproposed solutions

Pending Publication Date: 2019-02-22
NETEASE (HANGZHOU) NETWORK CO LTD
View PDF11 Cites 28 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0010] For the above problems, no effective solution has been proposed

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Facial animation synthesis method, a device, a storage medium, a processor and a terminal
  • Facial animation synthesis method, a device, a storage medium, a processor and a terminal
  • Facial animation synthesis method, a device, a storage medium, a processor and a terminal

Examples

Experimental program
Comparison scheme
Effect test

preparation example Construction

[0044] According to one embodiment of the present invention, an embodiment of a method for synthesizing facial animation is provided. It should be noted that the steps shown in the flow chart of the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions , and, although a logical order is shown in the flowcharts, in some cases the steps shown or described may be performed in an order different from that shown or described herein.

[0045] This method embodiment can be executed in a mobile terminal, a computer terminal or a similar computing device. Taking running on a mobile terminal as an example, the mobile terminal may include one or more processors (the processor may include but not limited to a graphics processing unit (GPU) or a microprocessor (MCU) or a programmable logic device (FPGA), etc. processing means) and a memory for storing data, optionally, the above mobile terminal may also include a transmission means for...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a facial animation synthesis method, a device, a storage medium, a processor and a terminal. The method comprises: performing voice analysis on the audio file to obtain a phoneme time stamp file and an expression time stamp file, wherein the phoneme time stamp file comprises a timestamp and a duration of each phoneme corresponding to each character converted from the audiofile, and each character corresponds to at least one phoneme; acquiring a mouth shape sequence corresponding to a phoneme timestamp file, wherein the mouth shape sequence is used for describing mouthshape information corresponding to each phoneme in the phoneme timestamp file; acquiring an expression sequence corresponding to the expression timestamp file, wherein, the expression sequence is usedfor describing expression information corresponding to the expression timestamp file; and synthesizing mouth and expression sequences into facial animation. The invention solves the technical problemthat the speech analysis mode provided in the related art is easy to cause the large error of the speech animation synthesized in the follow-up, and affects the user experience.

Description

technical field [0001] The present invention relates to the field of computers, in particular to a method, device, storage medium, processor and terminal for synthesizing facial animation. Background technique [0002] Human facial information includes: expression and mouth shape. Under normal circumstances, changes in facial expressions and mouth shapes are independent. Among them, mouth shapes contain more high-frequency information, while expressions are more inclined to low-frequency expressions. For example, when an ordinary person is elaborating a sentence, the mouth shape will change frequently with the pronunciation. Relatively speaking, the expression changes are relatively slow, and even lack obvious changes. In general, facial information can be regarded as the fusion of two relatively independent parts, expression and mouth shape. [0003] Aiming at the integration of expressions and mouth shapes, the technical solutions provided in related technologies are ma...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T13/80
CPCG06T13/80
Inventor 陈晓威万里红张伟东张民英
Owner NETEASE (HANGZHOU) NETWORK CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products