Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Pedestrian detection method based on deep learning multi-network soft fusion

A technology of pedestrian detection and deep learning, which is applied in the fields of image processing, target detection and deep learning, can solve the problems of low detection performance, achieve the effect of improving detection accuracy, solving insufficient detection accuracy, and improving capabilities

Active Publication Date: 2020-04-17
UNIV OF ELECTRONICS SCI & TECH OF CHINA
View PDF9 Cites 15 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The regression-based target detection method is also called the first-order method. Compared with the method based on the target candidate area, the regression-based pedestrian detection method is much simpler, and it does not require candidate area extraction and subsequent resampling operations. Real-time detection can be achieved to a certain extent, but its detection performance is lower than that of the second-order method

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Pedestrian detection method based on deep learning multi-network soft fusion
  • Pedestrian detection method based on deep learning multi-network soft fusion
  • Pedestrian detection method based on deep learning multi-network soft fusion

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0063] A pedestrian detection method based on deep learning multi-network soft fusion, the flow chart of the implementation is as follows figure 1 As shown, it consists of two parallel computing parts: pedestrian candidate area extraction and pedestrian semantic segmentation. The semantic segmentation refines the final pedestrian detection results of the entire system. The system computing speed depends on the slow processing branch. Part of the results are fused and output. Specifically include the following steps:

[0064] Step 1: Input the image to be processed.

[0065] Step 2: Input the image from step 1 into a figure 2 In the YOLOv3 pedestrian candidate area generator of the Darknet-53-based network, pedestrian candidate areas are generated.

[0066] Further, the specific implementation steps of YOLOv3 in the step 2 are as follows:

[0067] Step 2.1. First, 3 scales (13*13, 26*26, and 52*52) are fused in the YOLOv3 network, and independent detection is performed on ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a pedestrian detection method based on deep learning multi-network soft fusion, and relates to the technical field of image processing, target detection and deep learning. Themethod comprises the following steps: S1, inputting a to-be-processed image; S2, inputting the to-be-processed image into a YOLO v3 pedestrian candidate region generator taking Darknet-53 as a basic network, and generating a pedestrian candidate region; S3, inputting the to-be-processed image into a front-end prediction module, and outputting C feature maps; s4, inputting the C feature maps into asemantic segmentation system, and outputting C feature maps containing context information; s5, fusing a result of the semantic segmentation system with a pedestrian candidate result generated by a pedestrian candidate region generator; s6: outputting a detection image. According to the method, the pedestrian candidate region generator and the semantic segmentation system are subjected to parallel soft fusion, pedestrians in various challenge scenes are efficiently detected, and meanwhile, the small target detection capability is improved.

Description

technical field [0001] The invention relates to the technical fields of image processing, target detection and deep learning, in particular to a pedestrian detection method based on deep learning multi-network soft fusion. Background technique [0002] Object detection is an important problem in computer vision, which requires detecting the location of objects in video or digital images. Object detection is widely used in image detection, object recognition, video surveillance and other fields. Pedestrian detection, as a branch of object detection problems, involves detecting specific human categories, and it has a wide range of applications in areas such as autonomous driving, person recognition, and robotics. [0003] The goal of pedestrian detection algorithms is to draw bounding boxes in images or videos that accurately describe the location of pedestrians in real time. However, this is difficult to achieve due to the trade-off between accuracy and speed. Because low-...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06N3/04G06N3/08
CPCG06N3/08G06V40/10G06V2201/07G06N3/045
Inventor 袁国慧叶涛王卓然彭真明潘为年柳杨孙煜成周宇杨博文张文超
Owner UNIV OF ELECTRONICS SCI & TECH OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products