Infrared and visible light fusion imaging method based on deep learning

Abstract

The invention discloses an infrared and visible light fusion imaging method based on deep learning. The method comprises the steps: collecting an infrared image and a visible light image of the same size for a target at the same time to form a target object image pair, carrying out the sub-image pair segmentation and preprocessing of sub-images in the target object image pair, and adding a noise image, inputting the sub-image pair added with the noise map into a trained image fusion model as an input image pair to obtain a fused image, wherein the image fusion model comprises a shallow feature extraction unit, an encoder, a fusion module and a decoder. The general fact that the source image contains noise is considered, the source image is used as the premise of actual imaging application, image denoising is performed in the image fusion process, and noise points in the source image pair are effectively prevented from being introduced into the fusion image; the method is very beneficial to application research of infrared and visible light fusion and a deep learning technology, and is expected to be widely applied to the fields of medical imaging, night monitoring and the like.

Description

technical field [0001] This application relates to the field of image fusion, in particular to a fusion imaging method of infrared and visible light based on deep learning. Background technique [0002] Infrared thermal imaging takes the thermal radiation information of the target as input, and can also detect the target when the light is insufficient and distinguish the target from the background according to the difference in radiation. Visible light sensors use object reflectivity to image targets and can provide images with high resolution and sharp texture details. Infrared and visible light imaging systems can reflect different attributes of the same target at the same time, provide scene information from different aspects, and have a wide range of applications in military, video surveillance, car assisted driving, forest fire prevention and other fields. [0003] In recent years, with the widespread application of infrared and visible light imaging technology, the in...

AI Technical Summary

Problems solved by technology

[0004] The purpose of this application is to provide a deep learning-based infrared and visible light fusion imaging method to solve the problems of poor infrared imaging quality, serious noise interference and visible light images being easily affected by bad weather in infrared and visible light imaging systems

Images