Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Pedestrian Image Occlusion Detection Method Based on Recurrent Adversarial Generative Network

An occlusion detection and image technology, applied in the field of image analysis, can solve problems such as the inability to guarantee the robustness of the model, and achieve the effects of correcting detection results, reducing costs, and accurate results

Active Publication Date: 2020-07-14
SUN YAT SEN UNIV
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Since the mainstream general-purpose object detection method extracts a rectangular frame, it is slightly different from pixel-level tasks such as occlusion detection. In practical applications, many post-processing steps are inevitably involved, and the robustness of the model cannot be guaranteed. sex

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Pedestrian Image Occlusion Detection Method Based on Recurrent Adversarial Generative Network
  • Pedestrian Image Occlusion Detection Method Based on Recurrent Adversarial Generative Network
  • Pedestrian Image Occlusion Detection Method Based on Recurrent Adversarial Generative Network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0038] see figure 1 , 2 , this embodiment is based on the pedestrian image occlusion detection method of the cyclic confrontation generation network, comprising steps:

[0039] (1) Training stage 1, that is, the training sample image acquisition stage.

[0040] In this embodiment, pedestrian images with 625 IDs in the training set in the MARS dataset are used as unoccluded original pedestrian photos, and 6 categories including pedestrians, walls, vehicles, flowers and trees, umbrellas, tables and chairs are obtained from the ImageNet dataset and the Internet respectively. 731 images were used as occluded images, and finally 18,750 occluded images and their annotations were synthesized.

[0041]Before inputting the network for training, this embodiment performs operations such as removing the background in the occluder and Gaussian filtering on the occluder image to ensure that the quality of the generated image is close to the real image occlusion block. Since the proportio...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a pedestrian image occlusion detection method based on a cyclic confrontation generation network. The steps are: (1) randomly adding occlusion image blocks to an unoccluded pedestrian image to generate an occlusion pedestrian image and corresponding pedestrians with occlusion marks image; (2) take the above-mentioned pedestrian image with occlusion and the corresponding pedestrian image with occlusion label as two data domains, train the cyclic confrontation generation network model, and construct the mapping between the occlusion image and the occlusion label; (3) for the current For the input image to be labeled, use the trained cyclic confrontation generation network model to generate the occlusion label corresponding to the image, and at the same time segment the image to be labeled to obtain several superpixel blocks. According to the occlusion label information in each superpixel block, The region growing method is used to get the final occluded region. The method of the invention can model different types of occlusions in the absence of occlusion labels, and obtain pixel-level occlusion area detection results.

Description

technical field [0001] The invention relates to an occlusion detection method in the field of image analysis, in particular to a method for detecting an occlusion area in a pedestrian image by using a cyclic confrontation generation network. Background technique [0002] Pedestrian re-identification aims to match the same pedestrian target from images taken from different perspectives and at different times. This problem is a very important problem in video security monitoring, especially for the tracking and positioning of key people, which has very practical significance. However, in the mainstream pedestrian re-identification task, the matching images are all pedestrian images acquired by pedestrian detectors, and these detected images are often accompanied by occlusions. The occlusion in the image will greatly interfere with the original pedestrian texture features, which greatly reduces the accuracy of the subsequent pedestrian re-identification task. In order to avoi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06K9/00G06K9/34
CPCG06V20/53G06V10/267
Inventor 赖剑煌陈泽宇卓嘉璇
Owner SUN YAT SEN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products