Image snow removal algorithm based on snow model and deep learning fusion

A deep learning and image technology, applied in image enhancement, image analysis, image data processing, etc., can solve the problem of not being able to remove wide and opaque snowflakes, achieve improved snow removal efficiency, wide application range, and improve robustness Effect

Active Publication Date: 2020-06-12
SHENYANG INST OF AUTOMATION - CHINESE ACAD OF SCI
View PDF2 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Therefore, these prior-based rain and snow removal methods can only remove some narrow snow streaks and semi-transparent snowflakes, and they are usually unable to remove wide opaque snowflakes.
In recent years, there have been some algorithms based on deep learning to remove rain, and these methods can only remove translucent and narrow snowflakes

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image snow removal algorithm based on snow model and deep learning fusion
  • Image snow removal algorithm based on snow model and deep learning fusion
  • Image snow removal algorithm based on snow model and deep learning fusion

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0047] The present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments.

[0048] 1. Snow model

[0049] This paper derives a simplified snow model from the process of snowflakes passing through a certain pixel. Usually, the time for snowflakes to fall through a certain pixel is much shorter than the exposure time of the camera, so the snowy image captured by the camera is the result of the joint action of the fast-moving snowflakes and the background information occluded by the snowflakes. Such as figure 1 As shown, assuming that the exposure time of the camera is T, the time for snowflakes to pass through a certain pixel is τ, and during the shooting time [τ,τ+T], the process of snowflakes passing through a certain pixel, the light intensity of the pixel affected by the snowflake is given by The background light intensity and the snowflake light intensity are composed together, that is, the light intensity at the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to an image snow removal algorithm based on snow model and deep learning fusion. Aiming at the problem that the robustness of the visual system of the co-melting robot is influenced by snow weather, a simplified snow model is deduced according to the imaging process of snow, then an image deep snow removal network based on the model is designed, and the network is formed by connecting a snowflake detection sub-network and a snow removal sub-network in series. The snowflake detection sub-network adopts a residual learning network, and the network can accurately learn the difference between a snow image and a snow-free image. And the snow removing sub-network adopts a densely connected U network. On one hand, detail information of a background is reserved by using U-net, on the other hand, the snow removal accuracy is improved by using the characteristic that DenseNet multiplexes low-layer features to high-layer features, and after the detail information and the snow removal accuracy are combined, the contradiction between background detail loss and incomplete snow removal caused by excessive snow removal is relieved. Experiments prove that the deep snow removalnetwork based on the snow model can better detect and remove snowflakes in the image.

Description

technical field [0001] The invention relates to an image processing algorithm, in particular to an image snow removal algorithm based on snow model and deep learning fusion. Background technique [0002] Often, bad weather causes image degradation, which reduces the robustness of computer vision systems. At the same time, bad weather will also bring certain troubles to human vision. For example, people driving in rainy and snowy weather can easily cause traffic accidents. Bad weather conditions are generally divided into two categories: static (fog, haze) and dynamic (rain, snow). Static bad weather is usually caused by small particles floating in the air, which mainly reduce the clarity of the image. Dynamic bad weather is usually caused by large particles moving randomly, which partially occlude the image. Therefore, the restoration of images under static bad weather conditions is mainly to improve the clarity of the images, while the restoration of images under dynamic ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T5/00G06T3/00
CPCG06T2207/10004G06T2207/20081G06T2207/20084G06T3/053G06T5/73Y02A90/10
Inventor 田建东尹赫李鹏越唐延东
Owner SHENYANG INST OF AUTOMATION - CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products