Image fusion system based on low-light and infrared sensor

Abstract

The invention relates to an image fusion system based on a low-light and infrared sensor. The system is divided into a low-light and infrared sensor information acquisition module, an FPGA core processing module, a DSP co-processing module and an output display module; video images collected by the external low-light and infrared sensor are input to a device through an interface; the input video images are subjected to image preprocessing including image denoising, image enhancement and image registration, wherein image denoising and image enhancement are low in delay requirement and are achieved in an FPGA chip, the computation amount required for an image registration algorithm is large, and image registration is achieved in a DSP chip; the pre-processed video images are fused through the FPGA chip, wherein grayscale fusion and pseudo-color fusion are included; an FPGA control logic can select one path of images to be output through the interface, wherein one path of images include asingle low-light video, a single infrared video, a grayscale fused video and a pseudo-color fused video. The image fusion system is high in precision, low in delay and good in expansibility and has important practical significance on nighttime observation and exploration application.

Description

technical field [0001] The invention relates to an image fusion system based on low-light and infrared sensors, which is suitable for observation and detection of outdoor scenes by a sighting system at night, and belongs to the technical field of digital image processing. Background technique [0002] Different image sensors can receive spectral signals of different bands, and the response to the spectrum far exceeds the ability of the human eye, so richer image information can be obtained. In practical applications, people often need to combine the information provided by different sensors for analysis and processing. In view of the consideration of portability, the information of multiple sensors in more application scenarios needs to be displayed through a display device; image fusion technology is a kind of Multi-source images obtained by various sensors are refined and integrated into one image to obtain a more accurate and comprehensive description of the same scene. ...

AI Technical Summary

Problems solved by technology

[0005] Patent (publication number) CN107045208A proposes a method of optical fusion, the system delay is low, but there are problems that the information of a single sensor cannot be viewed and the collected images cannot be saved; while the full digital fusion method can solve the problem of optical fusion However, due to the limitations of hardware and the performance of the sensor, the actual source images often cannot be directly fused by the fusion algorithm to achieve effective image fusion, and need to be fused after preprocessing such as image correction, enhancement, and registration.

[0006] The patent (publication number) CN107203987A proposes an all-digital fusion system, and proposes a system solution using a multi-core heterogeneous processor AM572x plus a multi-core heterogeneous processor DSP. Image preprocessing is performed by the camera's image processor (ISP) chip Realized, but the scalability is relatively poor

Images