Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Parallel method of object detection and semantic segmentation based on end-to-end depth learning

A target detection and deep learning technology, applied in the field of computer vision of artificial intelligence, can solve the problems of lack of pertinence and manual design, division of target object boundary information, lack of diversity changes, etc., to achieve real-time target detection and target segmentation. Effect

Active Publication Date: 2019-03-29
SUN YAT SEN UNIV
View PDF3 Cites 34 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] For the existing deep learning target detection, the region selection strategy based on the sliding window lacks pertinence and hand-designed features are not robust to diversity changes. At the same time, the semantic segmentation field of deep learning performs pixel segmentation on multiple types of target objects in the image. The division of levels, the problem of insufficient division of the boundary information of the target object, the present invention proposes a natural language sentiment analysis method based on a deep network, the technical solution adopted by the present invention is:

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Parallel method of object detection and semantic segmentation based on end-to-end depth learning
  • Parallel method of object detection and semantic segmentation based on end-to-end depth learning
  • Parallel method of object detection and semantic segmentation based on end-to-end depth learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0034] Such as Figure 1-2 As shown, a parallel method of object detection and semantic segmentation based on end-to-end deep learning includes the following steps:

[0035] Darknet-19 of S1 construction and training target detection branch

[0036] S1.1 Collecting images: Download the PASCAL VOC data set from the Internet, which provides a set of standard excellent data sets for image detection and image segmentation. This method uses this data set to fine-tune and test the model;

[0037]S1.2 Preprocessing the target data set: Use common scale transformation, random cropping, noise addition, and rotation transformation to preprocess the image to enhance the robustness of the model; this step makes the input scale of the target data set fixed from the beginning The size is randomly transformed to the size of n*32, and the value range of n is 9-19; the default input scale is 618;

[0038] S1.3 Generating feature images: The basic network structure used by Darknet-19 does not...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a parallel method of target detection and semantic segmentation based on end-to-end depth learning, which obtains a model compose of a target detection neural network Darknet-19, a target segmentation full convolution neural network FCN by training a massive labeled target detection frame and a pixel-level target segmentation image. , and tasks of parallel target detection and target segmentation are successfully realized. That method can effectively extract image features, realizes real-time image processing functions on the basi of ensuring target detection and targetsegmentation, and has a wide application prospect.

Description

technical field [0001] The invention relates to the field of computer vision of artificial intelligence, in particular to a parallel method of target detection and semantic segmentation based on end-to-end deep learning. Background technique [0002] In the field of deep learning target detection, two problems are mainly solved. One is the classification and positioning of multiple targets in the image. Its development process is divided into three stages. One is the traditional target detection method, and the other is Regions with CNNfeatures (R-CNN) is a target detection framework that combines region proposals and CNN classification, such as: Fast R-CNN, Faster R-CNN, and the third is You Only Look Once (YOLO) as a representative of the target The end-to-end (End to End) target detection framework that detects regression problems, such as: SSD; the traditional method has a sliding window-based region selection strategy that lacks pertinence and hand-designed features are...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/62G06N3/04
CPCG06N3/045G06F18/21G06F18/24
Inventor 胡海峰尹靓璐
Owner SUN YAT SEN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products