Multi-scale real-time monitoring video stitching device based on feature points and multi-scale real-time monitoring video stitching method

Abstract

The invention relates to the technical fields of image processing and video processing, and provides a multi-scale real-time monitoring video stitching device based on feature points and a multi-scale real-time monitoring video stitching method. The multi-scale real-time monitoring video stitching device comprises cameras, video decoding circuits, a video capture module, image pre-processing modules, an SDRAM control module, an image interception and conversion module, a feature point extraction module, a feature point filter module, an image fusion cutting module, an output control module, a feature point matching module and an image homography matrix calculation module, wherein the cameras are connected with the video decoding circuits; the video capture module is connected with a plurality of the video decoding circuits and the image pre-processing modules; the SDRAM control module is connected with other modules; the feature point matching module is connected with the feature point extraction module and the feature point filter module; and the image homography matrix calculation module is connected with the feature point filter module and the image fusion cutting module. According to the multi-scale real-time monitoring video stitching device disclosed by the invention, a video with a wide viewing angle can be generated by performing seamless stitching on video data acquired by a plurality of paths of high definition cameras, so that the requirements for real-time performance can be met, and the stitching accuracy can be increased.

Description

technical field [0001] The invention relates to the technical field of image processing and video processing, in particular to a multi-scale real-time monitoring video splicing device and splicing method based on feature points. Background technique [0002] With the development of video surveillance technology, the images collected by video show the characteristics of high-definition and high frame rate. The number of cameras saves costs; however, the large amount of data and high frame rate in video surveillance bring great difficulties to real-time video splicing. [0003] Before the emergence of image stitching technology, panoramic image acquisition methods mainly include scanning panoramic cameras and wide-angle cameras, but these devices are expensive, complicated to operate, and the obtained images have obvious edge distortion. After these devices are applied to the field of video surveillance, the surveillance personnel cannot effectively observe the edges of the c...

AI Technical Summary

Problems solved by technology

[0005] After searching the existing literature, it is found that in the research of image and video stitching technology based on SURF features, a video stitching technology based on SURF algorithm is proposed. Although it can meet the requirements of video stitching in terms of real-time and accuracy, the system is in Implemented on a PC, it takes up a lot of space and has poor mobility, so it is not suitable for the actual video surveillance field

[0006] In addition, an FPGA-based surveillance video splicing method is proposed in the FPGA-based monitoring video real-time splicing device and splicing method, but the main algorithm calculation module in the system is processed in the Nios II microprocessor, and the processing speed cannot support relatively high Stitching of high-definition images at high frame rates

Images