Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method for realizing facial expression migration of cyclic generative adversarial network based on spectrum normalization

A technology of facial expression and implementation method, which is applied in the field of facial expression migration, can solve the problems of overall color change of the picture, change of other areas of the face, etc., and achieve a good robustness effect

Inactive Publication Date: 2019-08-02
NANJING UNIV OF POSTS & TELECOMM
View PDF0 Cites 45 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The cyclic generative confrontation network is suitable for dealing with image style transfer, but it is easy to change the overall color of the image when it is applied to the process of local feature transfer of the image such as face removal glasses, that is, changes in other areas of the face may occur after the face removal glasses

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for realizing facial expression migration of cyclic generative adversarial network based on spectrum normalization
  • Method for realizing facial expression migration of cyclic generative adversarial network based on spectrum normalization
  • Method for realizing facial expression migration of cyclic generative adversarial network based on spectrum normalization

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0041] Objects, advantages and features of the present invention will be illustrated and explained by the following non-limiting description of preferred embodiments. These embodiments are only typical examples of applying the technical solutions of the present invention, and all technical solutions formed by adopting equivalent replacements or equivalent transformations fall within the protection scope of the present invention.

[0042] The present invention discloses a method for implementing facial expression transfer based on spectral normalization-based cyclic generative adversarial network. The specific process is shown in the attached figure 1 As shown, the method includes the following steps:

[0043] S1: Collect various facial expression pictures, and classify them one by one according to the facial expressions, and obtain the classified facial expression data set;

[0044] The details are as follows: Find a picture website, find pictures of facial expressions and e...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a method for realizing facial expression migration of a cyclic generative adversarial network based on spectrum normalization, which comprises the following steps of: S1, collecting various facial expression pictures, and classifying the facial expression pictures one by one according to facial expressions; S2, preprocessing the pictures, removing blurred pictures, obtaining five key points of the human face by using a human face detection algorithm, and uniformly cutting face pictures according to the key points; S3, constructing a cyclic generative adversarial networkconsisting of a generator and a discriminator, respectively inputting the two types of preprocessed pictures into the network to calculate a loss function, and training the loss function; and S4, obtaining the trained generator as a tool for human face expression migration, and applying the trained generator to actual measurement. The cyclic generative adversarial network based on spectrum normalization can enable one generator to realize migration of multiple facial expressions, and the generated facial expressions can be more natural and have better robustness.

Description

technical field [0001] The invention relates to a realization method of human facial expression migration based on a spectral normalization cycle generation confrontation network, which can be used in the technical field of image processing in computer vision. Background technique [0002] In recent years, with the rapid development of artificial intelligence, deep learning has also become a popular research field, and the proposal of generative confrontation network has accelerated the process of deep learning. Scholars such as Ian Goodfellow of the University of Montreal proposed the generative confrontation network in 2014. In recent years, the generative confrontation network has become one of the research hotspots in deep learning. [0003] A Generative Adversarial Network is a generative model whose structure is inspired by two-person zero-sum games. Generative adversarial networks consist of a generator and a discriminator. The generator can learn from the latent di...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06K9/00G06T3/00
CPCG06V40/172G06V40/161G06V40/174G06T3/04
Inventor 吴晨李雷陈芸
Owner NANJING UNIV OF POSTS & TELECOMM
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products