Multi-camera system calibration method based on pedestrian head recognition

Abstract

The invention discloses a multi-camera system calibration method based on pedestrian head recognition, and belongs to the technical field of computer vision. The method comprises the following steps:processing each frame of image, and extracting an ellipse of a head portrait in the image by using a CNN method; calculating the three-dimensional position of the human head in each frame under a camera coordinate system according to the position and the size of the ellipse; selecting any camera coordinate system as a world coordinate system, and calculating external parameters of other cameras; and optimizing the obtained camera external parameters, and performing alignment conversion on the camera world coordinate system and the selected world coordinate system. According to the method, thehuman head is used as a feature point, the point cloud formed by the motion trail of the human head is used as a virtual calibration object, the method for calculating the three-dimensional coordinates of the head under the monocular single-frame image is provided, and the multi-camera external parameter calibration problem is converted into the three-dimensional point cloud alignment problem. Therefore, real-time online accurate external parameter calibration of the multi-camera system is completed by calculating the relative pose between the three-dimensional point clouds.

Description

technical field [0001] The invention belongs to the technical field of computer vision, in particular to a multi-camera system calibration method based on pedestrian head recognition. Background technique [0002] With the rapid development of computer vision technology and artificial intelligence related fields, multi-camera systems have been more and more widely used in scene reconstruction, smart city security monitoring, airport monitoring, motion capture, sports video analysis and industrial measurement. In recent years, solutions that use cameras as input have rapidly occupied a strong position in the market due to their excellent features such as high performance, high convenience, and high stability. Although multi-camera has great advantages in information processing and integration, the stable and normal operation of a multi-camera system requires an accurate and fast calibration process. [0003] The traditional calibration method is to use the known scene struct...

AI Technical Summary

Problems solved by technology

Although multi-camera has great advantages in information processing and integration, the stable and normal operation of a multi-camera system requires an accurate and fast calibration process

[0003] The traditional calibration method is to use the known scene structure information for calibration, which usually involves the production of precise calibration objects, complex calibration process and high-precision known calibration information, requiring complex operations by professionals

Moreover, every time the position of the camera group is changed in the future, the calibration operation needs to be performed again

Images