Infrared road scene segmentation method based on category prototype regression

A technology of scene segmentation and classification, applied in the field of image processing, can solve problems such as large traffic flow, difficulty in algorithms to achieve high accuracy, and difficulty in distinguishing

Active Publication Date: 2021-02-19
NANJING UNIV OF SCI & TECH
View PDF4 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] At present, the most complex vehicle-mounted road scene is the urban street scene, because in the street, the scene is complex and changeable, the background and the target are mixed together, it is difficult to distinguish, and the traffic volume on the road is large, sometimes there is dense situation, the general algorithm is difficult To achieve higher precision, at present, it is difficult for intelligent driving to achieve zero errors

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Infrared road scene segmentation method based on category prototype regression
  • Infrared road scene segmentation method based on category prototype regression
  • Infrared road scene segmentation method based on category prototype regression

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0055] The present invention is described in further detail now in conjunction with accompanying drawing. These drawings are all simplified schematic diagrams, which only illustrate the basic structure of the present invention in a schematic manner, so they only show the configurations related to the present invention.

[0056] Such as figure 1 As shown, the infrared road scene segmentation method based on category prototype regression of the present invention, the input image is set as P and after the feature extractor composed of convolutions, the depth features of each position are obtained , . After getting the features, use the category feature prototype proto Construct a relationship matrix with deep features; after obtaining the relationship matrix, use the relationship matrix to calculate the attention map, and obtain the final feature map through the feature fusion mechanism. It is worth noting that two paths are used to calculate the spatial attention map and ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to an infrared road scene segmentation method based on category prototype regression, and the method comprises the following steps: 1, category prototype feature regression: obtaining a category feature prototype through regression through a large number of data tags and depth features, 2, construction of a relation matrix: after obtaining a category feature prototype, constructing the relation matrix through depth features and the category feature prototype, 3, attention enhancement: constructing different attention graphs through the relation matrix to realize feature enhancement, and 4, construction of attention modules: establishing a category attention module and a space attention module, and aggregating the functions of the two attention modules. According to the method, a strategy of category prototype regression is proposed to perform regression on the whole data set, representative category prototype features are obtained, and meanwhile, network depth features are clustered, so that global category features are tighter, and meanwhile, the difference between the categories is amplified, and a relation matrix and an attention module are correspondinglyconstructed, so that the overall characteristics are tighter, and the final image segmentation precision is improved.

Description

technical field [0001] The invention relates to an infrared road scene segmentation method based on category prototype regression, and belongs to the technical field of image processing. Background technique [0002] Compared with other scenes, vehicle road scenes are more complex, and many problems may occur in complex scenes, such as complex backgrounds that make target recognition more difficult, or similarities between targets that interfere with visual features , Different targets are misclassified, especially in the infrared vehicle road scene, the edge of the target is weak, and the boundary line between the background and the foreground is not obvious, which will lead to the accuracy of visual features. Therefore, in order to achieve higher recognition accuracy, the segmentation model needs to have stronger discriminative ability for weak edges and similar objects. At present, image semantic segmentation technology is mainly aimed at classification tasks at the pixe...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/34G06K9/00G06K9/62G06N3/04
CPCG06V20/56G06V10/267G06N3/045G06F18/23G06F18/22G06F18/24G06F18/214
Inventor 韩静陈霄宇李端阳张权滕之杰魏驰恒李怡然
Owner NANJING UNIV OF SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products