Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Unsupervised image rain removal method based on attention generative adversarial network

An attention and unsupervised technology, applied in the field of neural network models, can solve problems such as data acquisition difficulties, achieve the effect of increasing the receptive field, improving the ability of discrimination, and improving the ability of image restoration

Pending Publication Date: 2021-07-30
NANJING UNIV OF AERONAUTICS & ASTRONAUTICS
View PDF0 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Aiming at the above problems, the present invention proposes an unsupervised rain removal method for the confrontation generation network that introduces the attention mechanism, which can effectively overcome the difficulty in obtaining paired data required for training the generation confrontation network, and introduces the attention mechanism, Make the network focus on the rainy area when processing the image, and output a more ideal rain-free image

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Unsupervised image rain removal method based on attention generative adversarial network
  • Unsupervised image rain removal method based on attention generative adversarial network
  • Unsupervised image rain removal method based on attention generative adversarial network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0042] In order to clearly illustrate the technical characteristics of this patent, the following describes this patent in detail through specific implementation methods and in conjunction with the accompanying drawings.

[0043] The present invention as Figure 1-4 As shown, the image processing is performed as follows:

[0044] First, build and preprocess the data set through step 1, and divide the data set into training set, verification set and training set according to the ratio of 70%, 15%, and 15%. Then step 2 builds the network model, step 3 trains the discriminator D, and trains the generators G and F respectively. Step 4 Separately extract the generator F from the trained model for cross-validation and testing.

[0045] Step 1. Build a dataset: collect information-related similar scene rain images and clear images as a network training dataset. Data sources include online open source image databases and self-built image datasets, and preprocess all images; Step 1 ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an attention generative adversarial network-based unsupervised image rain removal method, relates to the field of computer vision, and mainly relates to a neural network model capable of carrying out unsupervised learning and improving a picture rain removal effect. The problem that paired data are difficult to acquire when the generative adversarial network is trained can be effectively solved, and an attention mechanism is introduced, so that the network focuses on a rain area when processing an image, and a more ideal rain-free image is output. The method comprises the steps of 1, constructing a data set; 2, building a convolutional neural network; 3, training the network; 4, putting the process into actual use. Two discriminators of the original cyclic adversarial generative network are replaced by one discriminator, the network is simplified, the calculation amount is reduced, the discrimination capability of the discriminator is improved, and the image recovery capability of the generator is further improved. Therefore, the network focuses on a rain area when processing the image, and a more ideal rain-free image is output.

Description

technical field [0001] The present invention relates to the field of computer vision, and mainly relates to a neural network model capable of performing unsupervised learning and improving the effect of removing rain from pictures. The visibility of images processed by the network model is significantly improved. It is mainly used in image style conversion and data enhancement of automatic driving target recognition. Background technique [0002] Rain can degrade the visual quality of captured images and videos. Rain streaks (especially in heavy rain) can severely obscure the background. The accumulation of rainwater makes the distant rain streaks impossible to see alone, and together with the water particles, forms a veil on the background, which greatly reduces the contrast and visibility of the background. Human vision and many computer vision algorithms suffer from this image corruption because common computer algorithms assume clear weather and do not separately accou...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T5/00G06N3/04G06N3/08
CPCG06N3/088G06T2207/20081G06T2207/20084G06N3/048G06N3/045G06T5/73
Inventor 王鑫周冠李祥闫鹏飞郝岩梁帅王琪
Owner NANJING UNIV OF AERONAUTICS & ASTRONAUTICS
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products