Eureka AIR delivers breakthrough ideas for toughest innovation challenges, trusted by R&D personnel around the world.

Facial expression synthetic method based on rapid expression information extraction and Poisson image fusion

A facial expression and information extraction technology, applied in character and pattern recognition, filling plane with attributes, image data processing, etc., can solve the problems of insufficient facial expression effect, affecting image visual fidelity, and insufficient expression information Achieve the effect of maintaining light and skin color information, rich expression detail information, and robust expression detail

Inactive Publication Date: 2016-10-26
XIDIAN UNIV
View PDF2 Cites 23 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the processing methods based on the image domain are susceptible to the influence of illumination and noise, and the extracted expression information is not rich enough; in addition, these methods often require a neutral expression face image of the source object as a reference for extracting the detailed information of the expression. It is necessary to align the neutral and non-neutral expression images of the source object; and most of these methods achieve the fusion of the source object's expression details and the target object's facial features through simple weighting, resulting in a serious loss of expression details
For this reason, the facial expression effect synthesized by the above methods is often not significant enough, thereby affecting the visual fidelity of the image

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Facial expression synthetic method based on rapid expression information extraction and Poisson image fusion
  • Facial expression synthetic method based on rapid expression information extraction and Poisson image fusion
  • Facial expression synthetic method based on rapid expression information extraction and Poisson image fusion

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0028] The specific examples and effects of the present invention will be described in detail below in conjunction with the accompanying drawings.

[0029] refer to figure 1 , the present invention is based on fast expression information extraction and the facial expression synthetic method of Poisson fusion and mainly comprises the following steps:

[0030] Step 1, according to the position difference of the salient feature points of the face of the source object with the neutral expression and the non-neutral expression, the shape template of the salient feature points of the face of the target object with the non-neutral expression is obtained.

[0031] The present invention uses the Multi-PIE dataset as a multi-expression face dataset. The Milti-PIE dataset contains 337 objects, and each object has 15 kinds of attitude information and 20 kinds of lighting conditions. According to the different collection times, each collection time Nodes collect different facial expressio...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention discloses a facial expression synthetic method based on rapid expression information extraction and Poisson image fusion. The method mainly solves the problem in the prior art that the expression detail information can not be extracted rapidly and effectively and can not be synthesized to a target face, and comprises the realization steps of 1) obtaining a corresponding expression template according top the face characteristic point data; 2) according to an expression shape template of a target object, deforming a neutral expression image of the target object and a non-neutral expression image of a source object to the non-neutral expression shapes of the target object; 3) extracting the deformed expression detail information of a figure expression image block in a frequency domain; 4) using a Poisson image fusion method to filter the extracted expression details of the source object; 5) using the Poisson image fusion method to synthesize the filtered expression detail information to the deformation expression of the target object to thereby obtain a final synthesis result. The facial expression synthetic method of the present invention is small in needed sample capacity and natural and vivid in synthesis result, and can be used for the figure animation rendering, the video conference and the man-machine interaction.

Description

technical field [0001] The invention belongs to the fields of computer vision and computer graphics, in particular to a method for synthesizing human facial expressions. It can be used for character animation rendering, video conferencing and human-computer interaction. Background technique [0002] Facial expression is one of the external manifestations of internal subjective emotions, which has rich expressive power. Due to the diversity and complexity of facial expressions, facial expression synthesis must not only consider the overall movement and deformation of facial features, but also consider local subtle changes in expression textures. These expression details can often better reflect facial expression changes. , but these facial expression details are often difficult to obtain through expression simulation, and realistic expression details can be obtained through expression synthesis. How to extract the detailed texture of the expression from the complex expressi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T11/40G06T5/50G06K9/00G06T5/00
CPCG06T5/50G06T11/40G06T2207/30201G06V40/171G06T5/70
Inventor 田春娜李海洋高新波袁博王秀美李明郎君
Owner XIDIAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Eureka Blog
Learn More
PatSnap group products