Laser radar and camera combined calibration method

Abstract

The invention discloses a laser radar and camera combined calibration method, and the used laser radar scanning mode is non-repetitive scanning, i.e., the scanning tracks of laser radars are different each time, collection is performed for seconds in a static state, and the point cloud coverage rate in the visual field tends to be close to 100%. According to the non-repetitive scanning characteristic of the laser radar, the self-made large checkerboard calibration plates are sequentially placed at different positions in the overlapped view field of the laser radar and the camera, and the laser radar collects three-dimensional point cloud data for a long time while the camera collects a frame of image; the obtained three-dimensional point cloud data is converted into a two-dimensional normalized grey-scale map according to the point cloud intensity, corner detection is performed on the normalized grey-scale map and the camera image to obtain a corresponding two-dimensional grey-scale map and camera image corner pair, accurate three-dimensional point cloud corner coordinates are found out according to corner backtracking in the two-dimensional grey-scale map, and finally, a joint calibration result is obtained according to the corresponding three-dimensional point cloud corner points and camera image corner point coordinates, and compared with a traditional method, the method has higher precision.

Description

Technical field[0001]The present invention belongs to the field of multi-sensor data fusion, and in particular to a laser radar and a camera combined with a camera.Background technique[0002]Laser radar and camera are widely used in unmanned, intelligent robots.[0003]The advantage of laser radar is to accurately reflect the space 3D information of the environment, but in detail description, the camera cannot reflect the environmental space 3D information, but has a prominent effect in detail and color description. Therefore, in an unmanned system, it is necessary to fuse the laser radar and the camera to exhibit its own advantages. However, the premise of fusion is to combine them, and the coordinates on the space are unified. Most of the existing laser radar and camera integration methods are based on multi-wire repeat scanning laser radar. Since the product has been admitted late, the non-repetitive scanning laser radar is more involved.[0004]Open Source Automatic Driving Framework...

AI Technical Summary

Problems solved by technology

[0006] The purpose of the present invention is to provide a joint calibration method of laser radar and camera, which is based on the feature that the longer the scanning integration time of non-repetitive scanning laser radar, the higher the point cloud coverage, so as to solve the problem of low accuracy caused by the traditional joint calibration method

Images