Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Face restoration method based on multi-channel attention selection generative adversarial network

A technology for selecting generation and repair methods, applied in the field of deep learning and image processing, can solve problems such as image occlusion, incorrect color repair, strange artificial repair traces, etc., and achieve the effect of powerful optimization, quality improvement, and superior face repair methods

Active Publication Date: 2020-06-12
HUNAN UNIV
View PDF6 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] In order to solve the problems of image occlusion, incorrect coloring repair and strange artificial repair traces in face repair technology under certain conditions, the present invention provides a face repair method based on multi-channel attention selection generative confrontation network

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Face restoration method based on multi-channel attention selection generative adversarial network
  • Face restoration method based on multi-channel attention selection generative adversarial network
  • Face restoration method based on multi-channel attention selection generative adversarial network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0043] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0044] Please refer to Figure 1-Figure 3 , the present invention provides a face repair method based on multi-channel attention selection generation confrontation network, the steps of the face repair method are as follows:

[0045] S1. Collect face data and perform preprocessing: obtain face image pairs of the same person, including images with eyes open and eyes closed, and perform preprocessing on the collected images. Collect a large number of images as ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a face restoration method based on a multi-channel attention selection generative adversarial network. The method comprises the following steps of S1, collecting face data and performing preprocessing; s2, establishing a face restoration model and a loss function; s3, in the first stage, learning the image to generate a subnet Gi and preliminarily repairing the image; s4, inthe second stage, an intermediate output image IG is generated, and a multi-channel attention image IA is learned; s5, constructing a multi-channel attention selection model and outputting a final composite graph; s6, carrying out face restoration. Wherein the face restoration model comprises a generator network Gi, a parameter sharing discriminator D and a multi-channel attention selection network Ga, and the loss functions comprise an uncertainty pixel loss function and a resistance loss function. According to the face restoration method provided by the invention, the uncertainty graph is effectively learned to guide pixel loss, so that stronger optimization is realized, and a better face restoration method is provided.

Description

【Technical field】 [0001] The invention relates to the fields of deep learning and image processing, in particular to a face restoration method based on a multi-channel attention selection generative confrontation network. 【Background technique】 [0002] In the field of image inpainting, especially for intraocular painting, most deep learning techniques fail to preserve the identity of people in photos, although DNNs (deep neural networks) can produce semantically plausible and realistic-looking results. For example, a DNN can learn to open a pair of closed eyes, but the DNN itself cannot guarantee that the new eyes will correspond to the specific ocular structure of hominids. [0003] GAN (Generative adversarial networks) is a specific type of deep network that includes a learnable adversarial loss function represented by a discriminator network. GANs have been successfully used to generate faces from scratch, or to map missing regions on faces, suitable for general face ma...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06T5/00G06N3/04G06N3/08
CPCG06N3/08G06N3/045G06T5/77
Inventor 朱宁波曾乐程秋锋
Owner HUNAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products