Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Deflection face correction method based on generative adversarial network improved structure

A network and face technology, applied in the field of computer vision, can solve problems such as complex training process, difficult training, mode collapse, etc., and achieve high-quality results that avoid complex training, reduce network training difficulty, and achieve high-quality results

Active Publication Date: 2020-08-11
SOUTHEAST UNIV
View PDF1 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] Purpose of the invention: In view of the above problems, in the TP-GAN method of two-dimensional face conversion method, there are many training difficulties and the problem of easy mode collapse for the generation confrontation network DCGAN structure adopted by TP-GAN, and its impact on human The multi-scale image of the face is collected, which makes the training process relatively complicated. The present invention proposes a deflected face conversion method based on the improved structure of the generative confrontation network.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Deflection face correction method based on generative adversarial network improved structure
  • Deflection face correction method based on generative adversarial network improved structure
  • Deflection face correction method based on generative adversarial network improved structure

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0094] The technical solution of the present invention will be further described in detail below in conjunction with the embodiments and the accompanying drawings.

[0095] Under the Linux operating system, the Spyder software is selected as a programming tool to establish a generative adversarial network model. This example uses 13 different pose pictures of 337 individuals in the Multi-PIE face database under the same lighting condition for training, and tests on the LFW deflected face dataset.

[0096] figure 1 It is a schematic diagram of the network structure of the present invention, and the specific steps are as follows:

[0097] Step 1: Perform feature point detection on the face, and extract fixed size face area blocks (eyes, nose, mouth), the specific steps are as follows:

[0098] Step 1.1, normalize the face size to 128×128, and build a caffe deep learning environment;

[0099] Step 1.2, according to the key store extraction method proposed in the literature Com...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a deflection face correction method based on an improved structure of a generative adversarial network, and the method needs a plurality of deflection faces and face pairs formed by corresponding front faces during training, and only needs to deflect the faces during testing. The method comprises the following processing steps: (1) carrying out feature point detection on ahuman face, and extracting human face region blocks (eyes, nose and mouth) with fixed sizes; (2) respectively inputting the face region blocks and the overall face in the step (1) into a local channeland an overall channel to obtain a result after the local channel and the overall channel are corrected; (3) fusing the output of the local channel and the output of the overall channel, and settingthe pixel of the overlapping region as the maximum value on the region to obtain a final generated face; (4) inputting the generated face and the front face into a discriminator and a classifier to ensure that the accuracy and identity of the generated face are consistent; and (5) storing the network model obtained by training for testing. The adopted BEGAN network is simple in structure and efficient, and the accuracy and speed of deflection face correction are improved to a certain extent.

Description

technical field [0001] The invention relates to a deflected human face correction method based on an improved structure of a generative confrontation network, which belongs to the field of computer vision. Background technique [0002] With the continuous development of deep learning, many breakthroughs have been made in the research of face recognition. The recognition algorithm based on deep learning even exceeds the level of human naked eyes. However, most of these studies are based on the premise of frontal or approximate frontal faces, so these studies have certain limitations. Evidence shows that even the best-performing frontal face recognition methods suffer a significant drop in recognition rates at large angles of deflection. For face recognition under pose changes, existing methods can be roughly divided into the following three categories: feature extraction methods based on pose robustness, methods based on frontal face generation, and methods based on subspace...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06N3/04
CPCG06V40/172G06V40/161G06V40/168G06N3/045Y02T90/00
Inventor 达飞鹏胡惠雅
Owner SOUTHEAST UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products