Face transfer method capable of maintaining expression information based on CNN

A transfer method and expression technology, applied in the fields of computer vision and artificial intelligence, can solve problems such as loss of face information, loss of recognition information and expression information, disharmony between the synthesized part and the original part, etc.

Active Publication Date: 2018-10-12
SUN YAT SEN UNIV
View PDF2 Cites 13 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The present invention solves two core technical problems, one is the disharmony between the synthetic part and the original image part in the process of human face synthesis; the second is the loss of face information after the synthetic part and the original image part are synthesized, including identification information and expression information is lost

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Face transfer method capable of maintaining expression information based on CNN
  • Face transfer method capable of maintaining expression information based on CNN
  • Face transfer method capable of maintaining expression information based on CNN

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0033] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

[0034] figure 1 It is a flow chart of the face transfer method of the embodiment of the present invention, as figure 1 As shown, the method includes:

[0035] S1, obtaining face pictures from the network and face databases, and labeling information for classification of facial expressions of the face pictures to form a photo library;

[0036] S2, select two photos from the photo library as a group of samples, picture A is used as an identity information map, and ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a face transfer method capable of maintaining expression information based on CNN. The method achieves the face conversion effect of saving the feature information by combiningthe face recognition network and the expression recognition network, and may transfer the face of a picture A to the face of another picture B, and the expression information of the picture B and therest of the non-face information are still maintained during the conversion process. The invention solves two core technical problems that: the problem that the synthesized part is not in harmony with the original part in the process of face synthesis, and the problem of missing face information after the synthesis part and the original part are synthesized, including the lost of identification information and the expression information. By implementing the embodiments of the invention, the demand for image processing in people's lives may be increased, so that the face processing may be applied in various ways. At the same time, the "photographing unsuitable people" may generate more own images by means of image synthesis.

Description

technical field [0001] The invention relates to the fields of computer vision and artificial intelligence, in particular to a CNN-based face transfer method for maintaining expression information. Background technique [0002] In the 1980s, Hinton, Rumelhart and others established and promoted the back-propagation algorithm (back-propagation) used to train multi-layer neural networks, and the neural network ushered in the spring again. Through the back-propagation algorithm, people can further improve the computer's learning process to a level beyond the reach of previous learning algorithms after a huge amount of calculations by the computer. Deep Learning is a concept proposed by Professor Geoffrey Hinton of the University of Toronto. Because the traditional multi-layer perceptron is easy to fall into the local minimum, the classification effect directly obtained by the back propagation algorithm (Back Propagation) is not satisfactory. The first reason is that the feature...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/62G06N3/08
CPCG06N3/084G06V40/161G06V40/168G06V40/172G06F18/253G06F18/214
Inventor 曾坤潘文优陈湘萍
Owner SUN YAT SEN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products