Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Semantic segmentation method and system for automatic driving, electronic equipment and medium

A technology of semantic segmentation and automatic driving, applied in neural learning methods, instruments, biological neural network models, etc., can solve the problem of low performance of 3D point cloud semantic segmentation, and achieve the improvement of 3D semantic segmentation effect, efficient understanding, and reduction of computational complexity. degree of effect

Pending Publication Date: 2022-02-08
SOUTHWEST UNIVERSITY
View PDF0 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The present invention provides a semantic segmentation method, system, electronic equipment and medium for automatic driving to solve the problem of low semantic segmentation performance of 3D point clouds in the prior art

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Semantic segmentation method and system for automatic driving, electronic equipment and medium
  • Semantic segmentation method and system for automatic driving, electronic equipment and medium
  • Semantic segmentation method and system for automatic driving, electronic equipment and medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0084] (1) Selection of data set

[0085] In order to verify the performance of the semantic segmentation network model of this embodiment, the 3D point cloud data of this embodiment comes from a large-scale SemanticKITTI dataset and a small-scale SemanticPOSS dataset. The SemanticKITTI dataset is constructed by providing dense point semantic annotations for the full 360-degree scanned KITTI Odometry Benchmark. This dataset contains a total of 43,000 scans from 21 sequences. Among them, the 21000 scan data of the 00th to 10th sequences are used for training, the 08th sequence is used for verification, and the 11th to 21st sequences are used for testing. The SemanticPOSS data is a small-scale dataset created by Peking University, which contains 2988 complex scenes with high-quality dynamic objects. It follows the same data format specification as SemanticKITTI. There are 6 parts in this dataset, the 2nd and 3rd parts are used for testing, and the rest are used for training. ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention is suitable for the technical field of deep learning and automatic driving, and provides a semantic segmentation method and system for automatic driving, electronic equipment and a medium, and the method comprises the steps of obtaining three-dimensional point cloud data, mapping the three-dimensional point cloud data into a two-dimensional depth map comprising a plurality of pieces of channel data, and forming a sample data set according to the plurality of pieces of channel data; building a semantic segmentation network initial model comprising a first model and a second model, using the sample data set to train the semantic segmentation network initial model, obtaining a target model, where the second model comprises an encoder and a decoder; obtaining target three-dimensional point cloud data, mapping the target three-dimensional point cloud data into a target two-dimensional depth map, inputting the target two-dimensional depth map into the target model, and obtaining a target semantic segmentation result. Through adoption of the method, the problem of low semantic segmentation performance of the three-dimensional point cloud is solved.

Description

technical field [0001] The present invention relates to the technical fields of deep learning and automatic driving, and in particular to a semantic segmentation method, system, electronic equipment and medium for automatic driving. Background technique [0002] With the development of technology, artificial intelligence technology will be applied in more fields and play an increasingly important value. Semantic segmentation is one of the important applications in the field of artificial intelligence, and it is widely used in autonomous driving, video understanding, face recognition systems, intelligent hardware, etc. In the field of autonomous driving, accurate, robust, reliable, and real-time perception and understanding of the traffic environment can be achieved through accurate semantic segmentation of the traffic environment. [0003] At present, most autonomous driving systems use multiple types of sensors with complementary characteristics, such as cameras and radars...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06V20/56G06V10/26G06V10/40G06V10/774G06V10/80G06V10/82G06K9/62G06N3/04G06N3/08
CPCG06N3/08G06N3/045G06F18/253G06F18/214
Inventor 韩先锋程辉先肖国强
Owner SOUTHWEST UNIVERSITY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products