Eureka AIR delivers breakthrough ideas for toughest innovation challenges, trusted by R&D personnel around the world.

Object detection and tracking method of fusing laser point clouds and images

A target detection, laser point cloud technology, applied in the direction of instrument, character and pattern recognition, scene recognition, etc., can solve the problems of low stability and reliability, reduce image search space, underutilize point cloud information, etc., to achieve accurate goals Detection tracking, improving detection efficiency, high stability and reliability

Active Publication Date: 2018-09-07
NAT UNIV OF DEFENSE TECH
View PDF3 Cites 109 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] 1. The point cloud information measured by lidar is only used to reduce the search space of the image, and the point cloud information is not fully utilized, and the advantages of lidar and image data are not fully utilized;
[0006] 2. Since the search space on the image is reduced by using the point cloud information of the lidar first, and then the target detection and tracking is performed by the searched image data, when any sensor in the lidar or image acquisition fails, the entire detection system cannot work, the stability and reliability of the system is not high

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Object detection and tracking method of fusing laser point clouds and images
  • Object detection and tracking method of fusing laser point clouds and images
  • Object detection and tracking method of fusing laser point clouds and images

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0053] The present invention will be further described below in conjunction with the accompanying drawings and specific preferred embodiments, but the protection scope of the present invention is not limited thereby.

[0054] Such as figure 1 As shown, the target detection and tracking method of the fusion of laser point cloud and image in this embodiment, the steps include:

[0055] S1. Collect the laser point cloud data and image data of the target respectively, perform the first target detection according to the collected point cloud data, obtain the first target detection result, and perform the second target detection according to the collected image data, and obtain the second target detection result. Target detection results;

[0056] S2. Based on the Bayesian decision, the first target detection result and the second target detection result are fused and judged to obtain the final target detection result output;

[0057] S3. Perform target tracking according to the f...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an object detection and tracking method of fusing laser point clouds and images. The method comprises the steps of: S1, respectively collecting laser point cloud data and imagedata of an object, carrying out first object detection according to the collected point cloud data to obtain a first object detection result, and carrying out second object detection according to thecollected image data to obtain a second object detection result; S2, carrying out fusion judgment on the first object detection result and the second object detection result on the basis of Bayesiandecision to obtain final object detection result output; and S3, carrying out object tracking according to a final object detection result. The method has the advantages of a simple and highly-efficient realization method, high object detection and tracking accuracy, high environment adaptability and fault tolerance, stability, reliability and the like.

Description

technical field [0001] The invention relates to the technical field of target detection and tracking, in particular to a target detection and tracking method for fusing laser point clouds and images. Background technique [0002] Most of the current target detection and tracking methods are mostly based on image and video data, that is, relying on a single visual image information for target detection and tracking, but this type of single visual image information for target detection usually requires high quality, high resolution of the original image, and the limitations of the visual sensor itself make the lighting changes, occlusion between targets, shadows and other factors will have a serious impact on the quality of the collected images, such as severe weather such as strong winds, rain and snow or lighting changes, occlusion, Shadows, etc., greatly reduce the reliability of the detection results, the robustness of the detection system is poor, and the use of tracking ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06K9/00G06K9/34G06K9/32
CPCG06V40/10G06V20/13G06V10/25G06V10/267
Inventor 尹栋相晓嘉李梦洁李杰
Owner NAT UNIV OF DEFENSE TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Eureka Blog
Learn More
PatSnap group products