A real-time panoramic imaging system and method based on multiple cameras

Abstract

The invention discloses a real-time panoramic imaging system and method based on multiple cameras. The system includes multiple cameras, a raspberry pie, a router, and a computer; multiple cameras are used to collect surrounding area scenes; the raspberry pie and multiple The cameras are connected to drive the camera module to collect images and transmit the collected multi-channel image and video streams to the local area network; the router is used to build a local area network for data transmission and to transmit the video to the computer; the computer is equipped with a splicing module through the program , the splicing module extracts one frame of images from the obtained multi-channel video streams at the same time through a splicing algorithm and performs two-two splicing, and two adjacent images are paired into a group to obtain a panoramic image; the method first collects the scene; The feature points are extracted and matched; the pixel coordinates of the right image are mapped to the adjacent left image; the transition area is fused to improve the spliced ​​image. The invention improves real-time performance and imaging effect.

Description

technical field [0001] The invention belongs to the technical field of computer vision and image processing, in particular to a real-time panoramic imaging system and method based on multiple cameras. Background technique [0002] At present, splicing technology is mainly used in real-time monitoring areas in the traffic field, real-time live broadcast of large-scale concerts or conferences, vehicle-assisted driving equipment, and panoramic roaming in virtual reality. At present, there are relatively mature algorithms for image stitching, but at the same time, the degree of automation is not high enough, the stitching speed is slow, and it cannot meet the real-time requirements. In terms of panoramic imaging system, at present, there are mainly two ways to realize it. One is to use the large viewing angle of the fisheye lens to collect the surrounding scenes. There are two problems in this method. First, the fisheye lens will produce large distortion, which increases the di...

AI Technical Summary

Problems solved by technology

One is to use the large viewing angle of the fisheye lens to collect the surrounding scenes. There are two problems in this method. First, the fisheye lens will produce large distortion, which increases the difficulty of subsequent processing. Second, the fisheye lens The cost of the lens is high, and the promotion is difficult

The second is to use the architecture of FPGA+CPU, use multiple cameras to collect at the same time, and then stitch them together to form a panorama. This method is difficult to develop, and the real-time performance is average.

Images