Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

An Image Fusion System Based on Low Light and Infrared Sensors

An infrared sensor and image fusion technology, which is applied in the field of image fusion systems, can solve problems such as poor scalability, low system delay, and inability to view sensor information, and achieve good real-time performance, improved accuracy, and rich texture details.

Active Publication Date: 2019-05-14
BEIHANG UNIV
View PDF7 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] Patent (publication number) CN107045208A proposes a method of optical fusion, the system delay is low, but there are problems that the information of a single sensor cannot be viewed and the collected images cannot be saved; while the full digital fusion method can solve the problem of optical fusion However, due to the limitations of hardware and the performance of the sensor, the actual source images often cannot be directly fused by the fusion algorithm to achieve effective image fusion, and need to be fused after preprocessing such as image correction, enhancement, and registration.
[0006] The patent (publication number) CN107203987A proposes an all-digital fusion system, and proposes a system solution using a multi-core heterogeneous processor AM572x plus a multi-core heterogeneous processor DSP. Image preprocessing is performed by the camera's image processor (ISP) chip Realized, but the scalability is relatively poor

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • An Image Fusion System Based on Low Light and Infrared Sensors
  • An Image Fusion System Based on Low Light and Infrared Sensors
  • An Image Fusion System Based on Low Light and Infrared Sensors

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0044] The present invention will be described in detail below in conjunction with the accompanying drawings and embodiments.

[0045] like figure 1 As shown, it is the overall framework of the present invention, and the video images collected by the external low-light and infrared sensors are input into the system through the interface; the input video images are subjected to image preprocessing: including image denoising, image enhancement and image registration, wherein Image denoising and image enhancement processing requires low delay and is implemented in the FPGA chip. The image registration algorithm requires a large amount of calculation and is implemented in the DSP chip; the pre-processed video images are fused through the FPGA chip. Including gray-scale fusion and pseudo-color fusion; FPGA control logic can select one video image output through the interface: single low-light video, single infrared video, gray-scale fusion video and pseudo-color fusion video; PC co...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to an image fusion system based on a low-light and infrared sensor. The system is divided into a low-light and infrared sensor information acquisition module, an FPGA core processing module, a DSP co-processing module and an output display module; video images collected by the external low-light and infrared sensor are input to a device through an interface; the input video images are subjected to image preprocessing including image denoising, image enhancement and image registration, wherein image denoising and image enhancement are low in delay requirement and are achieved in an FPGA chip, the computation amount required for an image registration algorithm is large, and image registration is achieved in a DSP chip; the pre-processed video images are fused through the FPGA chip, wherein grayscale fusion and pseudo-color fusion are included; an FPGA control logic can select one path of images to be output through the interface, wherein one path of images include asingle low-light video, a single infrared video, a grayscale fused video and a pseudo-color fused video. The image fusion system is high in precision, low in delay and good in expansibility and has important practical significance on nighttime observation and exploration application.

Description

technical field [0001] The invention relates to an image fusion system based on low-light and infrared sensors, which is suitable for observation and detection of outdoor scenes by a sighting system at night, and belongs to the technical field of digital image processing. Background technique [0002] Different image sensors can receive spectral signals of different bands, and the response to the spectrum far exceeds the ability of the human eye, so richer image information can be obtained. In practical applications, people often need to combine the information provided by different sensors for analysis and processing. In view of the consideration of portability, the information of multiple sensors in more application scenarios needs to be displayed through a display device; image fusion technology is a kind of Multi-source images obtained by various sensors are refined and integrated into one image to obtain a more accurate and comprehensive description of the same scene. ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06T5/50G06T5/00G06T7/13G06T7/30
CPCG06T5/002G06T5/50G06T7/13G06T7/30G06T2207/10016G06T2207/10048G06T2207/20221
Inventor 张弘张泽宇杨一帆
Owner BEIHANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products