Bimodal signal fusion system and method

Abstract

The embodiment of the invention discloses a bimodal signal fusion system and method. The bimodal signal fusion system comprises: an image sensor unit, which is used for obtaining a bimodal image signal; an image processing unit which is connected with the image sensor unit, and is used for preprocessing synchronous signals and asynchronous signals in the bimodal image signals at the same time; andan image fusion unit which is connected with the image processing unit and is used for carrying out feature fusion on the synchronous signal and the asynchronous signal in the bimodal image signal. According to the scheme, the bimodal image signal processing efficiency of the image processing unit can be improved, the efficiency and real-time performance of the bimodal signal fusion system are further improved, heterogeneous feature fusion of the synchronous signal and the asynchronous signal is achieved, image signals with different types of image feature information are obtained, and the image fusion accuracy is improved. Therefore, the application range of the bimodal signal fusion system is wider.

Description

technical field [0001] Embodiments of the present invention relate to the technical field of image sensing, and in particular to a dual-mode signal fusion system and method. Background technique [0002] A visual sensor refers to an instrument that uses optical components and imaging devices to obtain image information of the external environment. The visual sensor in the prior art generally includes: Active Pixel Sensor (Active Pixel Sensor, APS) and Dynamic Vision Sensor (Dynamic Vision Sensor, DVS) . Among them, the active pixel sensor is usually an image sensor based on a voltage signal or a current signal, which is widely used in the camera unit of a mobile phone or a camera. This type of image sensor has the advantages of high color reproduction and high image quality. has less dynamic range and is slower to shoot. Dynamic vision sensors are often used in the field of industrial control. They are characterized by the ability to perceive dynamic scenes. Because of the...

AI Technical Summary

Problems solved by technology

However, when processing the image signal provided by the dynamic visual sensor, the image signal of the dynamic visual sensor includes unstructured, time-space related information, and the processor based on the "von Neumann" architecture shows low efficiency, high energy consumption, and poor real-time performance. And other issues

When the image signal that the image signal processing system needs to process is a dual-mode signal, the processor in the prior art cannot process the dual-mode signal in real time with high efficiency, thus affecting the application range of the image signal processing system

Images