Infrared and visible light image fusion method based on ResNet

An image fusion and visible light technology, applied in the field of infrared and visible light image fusion, can solve the problems of limited application range and insufficient utilization of intermediate layer information, achieve high contrast, less obvious vignette and block effect, and reduce artifacts and noise Effect

Active Publication Date: 2019-08-30
LANZHOU JIAOTONG UNIV
View PDF2 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] Although the methods based on deep learning have achieved better performance, there are still many shortcomings: 1) YuLiu's method is currently only suitable for multi-focus image fusion, and the scope of use is limited; 2) These methods only use the calculation of the last layer of the neural network As a result, much useful middle-level information is underutilized

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Infrared and visible light image fusion method based on ResNet
  • Infrared and visible light image fusion method based on ResNet
  • Infrared and visible light image fusion method based on ResNet

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0032] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0033] In this method, the source image is denoted as I k , k ∈ {1,2}. figure 1 As the frame diagram of this method, I k The basic part is obtained by two-scale decomposition through mean filtering and the details section The basic part is fused using the method of average weight to get F b, the detail part is processed by ResNet152 to obtain the maximum weight layer, and calculated with the detail part of the original image to obtain the d...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an infrared and visible light image fusion method based on ResNet. The infrared and visible light image fusion method comprises the following steps: decomposing a source imageinto a basic part and a detail part, and fusing the basic part by using an average weight strategy to generate a new basic part; carrying out feature extraction on the detail part by using ResNet152 to obtain a plurality of feature layers, respectively carrying out L1 regularization, convolution operation, bilinear interpolation upsampling and maximum selection strategies on the feature layers toobtain a maximum weight layer, and multiplying the maximum weight layer by the detail part to obtain a new detail part; and finally, reconstructing the image by the new basic part and the detail part.According to the infrared and visible light image fusion method, the fusion image obtains more texture information while image salient features are reserved, and artifacts and noise are effectively reduced.

Description

technical field [0001] The invention relates to the field of infrared and visible light image fusion, and more specifically relates to a simple and efficient infrared and visible light image fusion method based on a ResNet network. Background technique [0002] Image fusion is an image enhancement technology, which aims to combine information captured by different types of sensors to generate images with richer content and clearer details, so as to provide assistance for subsequent processing and decision-making. Infrared and visible light signals come from different modes. Infrared images capture thermal radiation information, while visible light images capture light information. Their combined information is richer than that obtained by using their individual modes. Visible light images have high spatial resolution and fine texture information, but are easily disturbed by weak light, fog and other harsh weather conditions; infrared images can resist these interferences, bu...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T5/50
CPCG06T5/50G06T2207/10048G06T2207/10024G06T2207/20221G06T2207/20032
Inventor 张黎明李恒陈金萍将美容
Owner LANZHOU JIAOTONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap