Multi-lens panoramic linkage device and method

Abstract

The invention provides a multi-lens panoramic linkage device and a method thereof, comprising the following steps of adopting integrated circuit chip technology: a preprocessing module processes a plurality of collected original images to obtain a plurality of real images; the panoramic mosaic module adopts the mosaic combination of multi-image geometric mapping transformation to mosaic the real image and adjust the whole image to get the panoramic mosaic image. The multi-dimensional vision processing module calculates the real image logically in multiple visual dimensions to obtain the functional image. The linkage combination module detects the target region in the panoramic mosaic image, and collects the local enhancement region matched with the target region in the functional image, and linkages the local enhancement region with the panoramic mosaic image to obtain the panoramic linkage image and linkage parameters. The invention integrates all logic modules in one chip, so as to enhance the linkage effect of the whole and the part, look at the whole situation and grasp the details, improve the response speed of the panoramic splicing linkage, reduce the development cost, and reduce the development difficulty and the product volume.

Description

technical field [0001] The invention relates to the field of integrated circuit chip design, in particular to a multi-camera panorama linkage device and method. Background technique [0002] The application of multi-camera panorama stitching and display has become very popular. At present, there are two mainstream implementation methods. One is to collect multiple images and send them to the background to realize stitching and display by software; the other is to use GPU (Graphics Processing Unit, graphics processing unit) , DSP (Digital Signal Processing, digital signal processing) and FPGA (Field-Programmable Gate Array, Field Programmable Gate Array) technologies perform panorama stitching of images at the front end, compress and package them and output them for display. Panoramic and partial linkage technology generally uses a global panoramic stitching image, plus a high-definition or telephoto lens to increase the linkage effect of local definition image recognition an...

AI Technical Summary

Problems solved by technology

However, the current existing solutions have the following disadvantages: only a single panoramic stitching function can be realized; the linkage between panoramic global and local camera recognition and tracking will be realized by back-end software solutions or GPU, DSP or FPGA technology to resist large data volumes It will no longer have the ability to do multi-dimensional vision algorithm applications such as partial magnification, night vision enhancement, depth detection, image recognition, feature point matching, etc., which greatly limits the popularization of this technology and is not conducive to ordinary individuals and families. Or small business applications; the current linkage technology with panoramic cameras will lead to large equipment, high power consumption, difficult development, and high implementation costs

Images