Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A 3D vehicle detection method based on multi-sensor fusion

A multi-sensor fusion and vehicle detection technology, which is applied in the directions of instruments, calculations, character and pattern recognition, etc., can solve problems such as poor robustness, low real-time performance, and long detection distance, so as to improve real-time performance, reduce calculation amount, The effect of improving accuracy

Active Publication Date: 2019-06-28
JIANGSU UNIV
View PDF2 Cites 40 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] A smart car is a complex system including perception, decision-making, and control technologies. Environmental perception provides fundamental information for path planning and decision-making control, and vehicle detection is an extremely critical task in the autonomous vehicle environment perception system. The mainstream obstacle detection sensor It is the camera and lidar. Now the vision-based vehicle detection has achieved good results. The camera is low in cost and can obtain the texture and color of the target, so it is widely used in intelligent driving. However, the camera is more sensitive to light and shadow parts. , cannot provide accurate and sufficient location information, often leading to problems such as low real-time performance or poor robustness
LiDAR can obtain the target distance and three-dimensional information, the detection distance is long and not affected by light, but the texture and color of the target cannot be determined, so a single sensor cannot meet the needs of autonomous driving

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A 3D vehicle detection method based on multi-sensor fusion
  • A 3D vehicle detection method based on multi-sensor fusion
  • A 3D vehicle detection method based on multi-sensor fusion

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0042] The present invention will be further described below in conjunction with accompanying drawing.

[0043] Vehicle detection is an extremely critical part of the autonomous vehicle environment perception system. This invention proposes a 3D vehicle detection method based on multi-sensor fusion. The detection flow chart is as follows figure 1 As shown, the details are as follows:

[0044] (1) Collect point cloud data through lidar, and camera to collect RGB image information, and preprocess the collected point cloud, and input the bird's eye view (BEV) of the point cloud as point cloud data, which is the point cloud data It is obtained by projecting to the 2D grid on the ground (Z=0). In order to obtain more detailed height information, take the lidar position as the center point, take the left and right positions of BEV [-40,40]m, and the front position [0,70] m. And according to the actual height of the car, take the Z-axis [0, 2.5]m, divide the point cloud into 5 hei...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a 3D vehicle detection method based on multi-sensor fusion, and the method comprises the steps: Step 1, obtaining the semantic information (i.e., an RGB image) of a vehicle through a camera installed on the vehicle, carrying out the scanning of the surrounding environment of the vehicle through a laser radar located at the top of the vehicle, and obtaining the precise depthinformation (i.e., laser radar point cloud) of the environment; Step 2, preprocessing the laser radar point cloud, taking Z-axis [0, 2.5] m according to the height of the automobile, and equally dividing the point cloud into five height slices along the Z-axis direction; Step 3, generating a 3D vehicle region of interest on the laser radar point cloud; Step 4, performing feature extraction on theprocessed radar point cloud and RGB image and generating corresponding feature maps; Step 5, respectively mapping the 3D vehicle region of interest to feature maps of the point cloud and the RGB image; and Step 6, fusing the feature maps of the mapping part in the step 5, and finally realizing 3D positioning and detection of the vehicle target.

Description

technical field [0001] The invention belongs to the field of automatic driving, and in particular relates to a vehicle 3D detection method based on multi-sensor fusion. Background technique [0002] A smart car is a complex system including perception, decision-making and control technologies. Environmental perception provides fundamental information for path planning and decision-making control, and vehicle detection is an extremely critical task in the autonomous vehicle environment perception system. The mainstream obstacle detection sensor It is the camera and lidar. Now the vision-based vehicle detection has achieved good results. The camera is low in cost and can obtain the texture and color of the target, so it is widely used in intelligent driving. However, the camera is more sensitive to light and shadow parts. , cannot provide accurate and sufficient location information, often leading to problems such as low real-time performance or poor robustness. LiDAR can obt...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/62G06K9/32G06K9/00
CPCY02T10/40
Inventor 蔡英凤张田田王海李祎承刘擎超陈小波
Owner JIANGSU UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products