Point cloud 3D target detection method based on symmetric point generation

A target detection and symmetry technology, applied in the field of 3D target detection and automatic driving, can solve problems such as dependence and inability to detect objects, and achieve the effect of reducing detection difficulty and improving detection accuracy.

Pending Publication Date: 2021-04-02
WUHAN UNIV
View PDF4 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This method will rely heavily on the semantic information of the image, resulting in the inability to detect occluded or severely truncated objects

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Point cloud 3D target detection method based on symmetric point generation
  • Point cloud 3D target detection method based on symmetric point generation
  • Point cloud 3D target detection method based on symmetric point generation

Examples

Experimental program
Comparison scheme
Effect test

specific Embodiment approach

[0145] Step 1: Filter the point cloud and voxelize the detection space, calculate the input of the symmetry point generation module, that is, the initial feature of the voxel, generate the foreground point label, and generate the position offset label of the symmetry point relative to the foreground point;

[0146] In step 1, filter the point cloud and voxelize the detection space as follows:

[0147] The original point cloud is:

[0148]

[0149] in, Indicates the coordinates of the i-th point, Represent the x-axis coordinates, y-axis coordinates, and z-axis coordinates of the i-th point respectively, and filter out the points in the original point cloud that are not within the detection range, and the detection range is

[0150]

[0151] Then the filtered point cloud is where O j Indicates the coordinates of the jth point in the detection range space, respectively represent the x-axis coordinate, y-axis coordinate and z-axis coordinate of the jth point in the ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a point cloud 3D target detection method based on symmetric point generation. The method comprises the following steps: firstly, filtering an original point cloud, voxelizinga detection space, generating initial voxel features, inputting the initial voxel features into a symmetric point generation module, obtaining high-level semantic features through a coding and decoding structure of the symmetric point generation module, and performing foreground point segmentation and symmetric point prediction through a classification head and a regression head; forming an enhanced point cloud by using the predicted symmetric point set corresponding to the foreground point and the non-empty voxel center point set as the input of the regional proposal network, further extracting the top view features through the backbone network of the regional proposal network, using the top view features as the input of the detection head, and finally outputting the 3D frame of the to-be-detected object by the detection head. According to the method, the symmetry of the detection object is utilized to generate the symmetry points, the problem of structural loss of the object in the point cloud is fundamentally relieved, the regression effect can be improved, the detection precision is improved, and meanwhile, replacement of RPN with other voxel-based detection methods is supported, so the original detector with a poor detection effect can generate a competitive detection result.

Description

technical field [0001] The invention relates to the technical fields of automatic driving and 3D target detection, in particular to a 3D target detection algorithm based on symmetrical point generation. Background technique [0002] 3D object detection has attracted more and more attention from industry and academia due to its wide application in autonomous driving, robotics and other fields. LiDAR sensors are widely used in autonomous vehicles and robots to capture 3D scene information in the form of point clouds and provide important information for the perception and understanding of 3D scenes. Since the point cloud can preserve the original size of the object, there is no problem of the object being too low resolution in the image, and the lidar can work normally even at night. Therefore, object detection in the point cloud scene has become a hotspot of 3D object detection. Currently, 3D object detection methods are mainly divided into two categories, one is image-base...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T7/00G06T5/00G06N3/04G06N3/08G06K9/62
CPCG06T7/0002G06T5/00G06N3/084G06T2207/10028G06V2201/07G06N3/045G06F18/214G06F18/253Y02T10/40
Inventor 邹炼范赐恩金伟正陈庆生李晓鹏李方玉
Owner WUHAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products