Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Single image defogging method based on sub-pixel and conditional antagonism generation network

A sub-pixel and image technology, applied in the field of single image defogging, can solve problems such as joint estimation of t, poor processing, and insufficient image defogging effect, and achieve high-quality generation, good recovery, and good visual effects

Inactive Publication Date: 2019-02-01
HARBIN INST OF TECH AT WEIHAI
View PDF8 Cites 20 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

First, although the manual method can effectively dehaze the image, most of the manual methods are poor in dealing with the sky region of the image and the region whose brightness is close to the global atmospheric light A
Second, although the dehazing method based on the deep learning method is better than the traditional method, the main processing target of these methods (including the traditional method) is t(x), while ignoring the global atmospheric light A, if t(x ) is not properly estimated, the overall image defogging effect is not good enough
Although a complete end-to-end dehazing method, such as AOD-Net, has appeared in recent years, its main idea is still dealing with t(x), and it cannot jointly estimate t(x) and A well.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Single image defogging method based on sub-pixel and conditional antagonism generation network
  • Single image defogging method based on sub-pixel and conditional antagonism generation network
  • Single image defogging method based on sub-pixel and conditional antagonism generation network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0042] Such as figure 1 As shown, a single image dehazing method based on sub-pixel and conditional confrontation generation network, including the following steps:

[0043] S1. Obtain the original fog-free image dataset, and synthesize the foggy dataset according to the foggy imaging model;

[0044] S2. Input the foggy image to be processed into the generator G. The network structure of the generator G is provided with layer-skip connections. After encoding, the output size is gradually reduced. After using the feature map of the convolution to operate on the feature map, the generator outputs a haze-free image;

[0045] S3. Input the fog-free image output by the generator G and the original fog-free image into the discriminator D, and judge whether the fog-free image output by the generator G is true;

[0046] S4. Simultaneously perform confrontation constraints on the generator G and discriminator D, calculate the confrontation loss and L1 loss, and perform backpropagatio...

Embodiment 2

[0048] A method for dehazing a single image based on sub-pixel and conditional adversarial generative networks, including the following steps:

[0049] S1. Dataset collection: Collect indoor and outdoor fog-free images, crop them to a size of 256×256, and classify them according to indoor and outdoor categories.

[0050] S2, synthetic data set: According to the foggy day imaging model shown in formula (1), on the basis of original fog-free data set, synthetic fog data set, wherein t (x) represents the concentration of fog, in the present invention, for To make the model have better generalization ability, use different t(x) to synthesize foggy images with different concentrations.

[0051] S3. Input the foggy image (Input) in the data set into the generator G. The function of the generator G is to restore the fog-free image from the input foggy image. Therefore, it is necessary to restore the structure and structure of the original image as completely as possible. Details. I...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a single image defogging method based on sub-pixel and conditional antagonism generation network, which comprises the following steps: obtaining an original fogless image dataset and synthesizing the fogged data set according to a foggy day imaging model; inputting the fogged image to be processed into a generator G, wherein the network structure of the generator G is provided with a skip layer connection, a feature map with gradually reduced encoding output size is encoded, and the feature map is respectively obtained by deconvolution and sub-pixel in a decoding stage, and then the feature map is operated by convolution to obtain a fogless image output by the generator; inputting the non-fog image and the original non-fog image output from the generator G into thediscriminator D, and judging whether the non-fog image output from the generator D is true or not; the generators G and the discriminator D are constrained by antagonism at the same time, and the antagonism loss and L1 loss are calculated. The parameters of the generators G and the discriminator D are updated by back propagation according to the principle of stochastic gradient descent. When thetotal loss of the model converges, the training of the model is completed.

Description

technical field [0001] The invention relates to the technical field of image processing and pattern recognition, in particular to a single image defogging method based on sub-pixel and conditional confrontation generation network. Background technique [0002] Due to the refraction of water vapor and solid particles in the atmosphere, the captured images appear foggy visually. Image dehazing aims to restore a clean haze-free image from a hazy image. The generation of high-quality haze-free images is very beneficial to the later work of segmentation, detection and recognition. The representation of a foggy image can be modeled as: [0003] I(x)=J(x)t(x)+A(1-t(x)) (1) [0004] where I(x) and J(x) are the observed hazy image and clear scene irradiance, A is the global atmospheric light, and t(x) is called the medium transmittance. Assuming that the fog concentration is uniform, we can express t(x)=e -βd(x) , where β is the medium extinction coefficient and d(x) is the scen...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T5/00
CPCG06T2207/20081G06T2207/20084G06T5/73
Inventor 张盛平孙嘉敏吕晓倩朴学峰董开坤张维刚孙鑫
Owner HARBIN INST OF TECH AT WEIHAI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products