Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Image reflection removing method based on depth convolution generative adversarial network

A deep convolution and image technology, applied in biological neural network models, image enhancement, image data processing, etc., can solve problems such as large differences in natural images, unsuitable natural images, and inability to describe distribution, and achieve flexible definition capabilities. Effect

Active Publication Date: 2017-08-29
SOUTH CHINA UNIV OF TECH
View PDF4 Cites 78 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The method of Levin et al. can achieve better results on images with simple scenes and sparse textures, but it is not suitable for more general natural images with rich texture information.
This is because the differences between natural images are very large, and their distribution cannot be simply described by a unified histogram
The methods of Li et al. and Shih et al. are aimed at images taken under specific conditions, which are not widespread, so the usage scenarios of these methods are very restrictive.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image reflection removing method based on depth convolution generative adversarial network
  • Image reflection removing method based on depth convolution generative adversarial network
  • Image reflection removing method based on depth convolution generative adversarial network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0054] The present invention will be further described below in conjunction with specific examples.

[0055] The image reflection removal method based on deep convolution confrontation generation network provided by this embodiment is as follows:

[0056] Step 1, obtain the public data set and divide it into training data set and verification data set, which are used in the model training phase and model verification phase respectively.

[0057] Step 2, preprocessing the images in the data set to meet the input requirements of the deep convolutional confrontation generation network, including the following steps:

[0058] Step 21, under the premise of maintaining the aspect ratio of the image, the image is scaled to a size where the length of the short side is 144 pixels.

[0059] Step 22, random cropping to obtain a square image with a size of 128×128 pixels.

[0060] Step 23, horizontally flip the image with a probability of 0.5.

[0061] Step 24, normalize the image from...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an image reflection removing method based on a depth convolution generative adversarial network. The method comprises the following steps: 1) data obtaining; 2) data processing; 3) model structuring; 4) loss defining; 5) model training; and 6) model verifying. In combination with the capability of a depth convolution neural network to extract high-level image semantic information and the flexible capability of the generative adversarial network to define the loss function, the method overcomes the limitations of a traditional method using low level pixel information, therefore, making the method with a better adaptive ability to the reflection removal of a generalized image.

Description

technical field [0001] The invention relates to the technical field of computer image processing, in particular to an image reflection removal method based on a deep convolutional confrontation generation network. Background technique [0002] When we take pictures of outdoor scenes through glass indoors, the resulting photos often contain reflected images of indoor objects. Professional photographers may choose to use professional equipment such as polarizers to solve this problem. But for the average consumer, it would be more feasible to post-process photos using reflection removal algorithms. [0003] A photo with a reflection image can be regarded as a mixed image formed by superimposing a reflection image (indoor scene) and a target image (outdoor scene). The essence of the reflection removal problem is to decompose two images from such a mixed image. This problem is obviously ill-posed, that is, for a given mixed image, the possible decomposition method is not uniq...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06T5/00G06K9/62G06N3/08
CPCG06N3/084G06F18/214G06T5/00
Inventor 徐雪妙周乐
Owner SOUTH CHINA UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products