Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Crowd counting method and system based on feature pyramid, medium and electronic equipment

A feature pyramid and crowd counting technology, applied in the field of computer vision, can solve the problems of missing more detailed information, difficulty in dealing with scale changes, and poor counting ability of small targets

Pending Publication Date: 2020-07-31
SHANDONG NORMAL UNIV
View PDF0 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The inventors of the present disclosure found that since a single-column convolutional neural network (Convolutional Neural Networks, CNN) only contains a receptive field of one scale, it is difficult to deal with the problem of scale change. The researchers proposed a series of multi-column CNN, multi-input CNN and multi- The task learns the CNN structure, but these multi-column CNNs generally use the highest-level feature map to regress to generate a density map, and the high-level feature map will lose more detailed information after layer-by-layer abstract expression and downsampling of the pooling layer. Even some small-scale targets are filtered out, resulting in poor counting ability of the algorithm for small targets

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Crowd counting method and system based on feature pyramid, medium and electronic equipment
  • Crowd counting method and system based on feature pyramid, medium and electronic equipment
  • Crowd counting method and system based on feature pyramid, medium and electronic equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0036] Such as figure 1 As shown, Embodiment 1 of the present disclosure provides a crowd counting method based on a feature pyramid, including the following steps:

[0037] Preprocessing the acquired image to obtain the initial crowd density map corresponding to the image;

[0038] Input the obtained initial crowd density map into the preset feature pyramid network model, extract feature maps at multiple levels, and obtain feature maps that integrate multi-scale context information at each level;

[0039] From the bottom layer to the top layer, the information transmission is updated layer by layer, and then the reverse information transmission is carried out to the bottom layer, and the feature maps of each layer obtained by the two-way information transmission are fused to obtain the final feature map of each layer;

[0040] The obtained final feature maps of each layer are reversely connected layer by layer to obtain the final crowd density map, and then the final crowd c...

Embodiment 2

[0075] Embodiment 2 of the present disclosure provides a feature pyramid-based crowd counting system, including:

[0076] The data preprocessing module is configured to: preprocess the acquired image to obtain an initial crowd density map corresponding to the image;

[0077] The feature extraction module is configured to: input the obtained initial crowd density map into the preset feature pyramid network model, extract feature maps at multiple levels, and obtain a feature map incorporating multi-scale context information at each level ;

[0078] The feature processing module is configured to: perform information transfer and update layer by layer from the bottom layer to the top layer, and then perform reverse information transfer to the bottom layer, and fuse the feature maps of each layer obtained by bidirectional information transfer to obtain the final feature map of each layer;

[0079] The crowd counting module is configured to: reversely connect the obtained final fea...

Embodiment 3

[0082] Embodiment 3 of the present disclosure provides a medium on which a program is stored. When the program is executed by a processor, the steps in the feature pyramid-based crowd counting method described in Embodiment 1 of the present disclosure are implemented, specifically:

[0083] Preprocessing the acquired image to obtain the initial crowd density map corresponding to the image;

[0084] Input the obtained initial crowd density map into the preset feature pyramid network model, extract feature maps at multiple levels, and obtain feature maps that incorporate multi-scale context information at each level;

[0085] From the bottom layer to the top layer, the information transmission is updated layer by layer, and then the reverse information transmission is carried out to the bottom layer, and the feature maps of each layer obtained by the two-way information transmission are fused to obtain the final feature map of each layer;

[0086] The obtained final feature maps...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a crowd counting method and a crowd counting system based on a feature pyramid, a medium and electronic equipment, which belong to the technical field of computer vision. The crowd counting method comprises the following steps of: preprocessing an acquired image to obtain an initial crowd density map corresponding to the image, inputting the initial crowd density map into apreset feature pyramid network model, and acquiring a feature map fused with multi-scale context information on each level; and carrying out information transmission updating layer by layer from the bottom layer to the top layer, then carrying out reverse information transmission until reaching the bottom layer, fusing the feature map of each layer obtained by bidirectional information transmission to obtain a final feature map of each layer, carrying out reverse layer-by-layer side edge connection to obtain a final crowd density map, and further acquiring a final crowd counting value. According to the crowd counting method and the crowd counting system, the multi-layer features are integrated through bidirectional message transmission, the problem of scale change in crowd pictures is solved by fusing feature maps of different scales in a network layer by layer, and more detail information is reserved, so that counting of multi-scale dense crowds with a better effect is realized.

Description

technical field [0001] The present disclosure relates to the technical field of computer vision, and in particular to a feature pyramid-based crowd counting method, system, medium and electronic equipment. Background technique [0002] The statements in this section merely provide background information related to the present disclosure and may not necessarily constitute prior art. [0003] Crowd analysis has important geopolitical and civic applications. Large mass gatherings are commonplace at candlelight vigils, pro-democracy protests, religious gatherings and presidential rallies. Civic agencies and planners rely on crowd counting to regulate access points and plan disaster responses for such events. Accurately estimating total crowd size from images has become increasingly important for crowd management and public safety. Crowd counting is a challenging task. Crowd images, especially high-density crowd images, have serious problems of crowd overlap and scale change. ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06K9/00G06K9/62G06N3/04G06N3/08
CPCG06N3/084G06V20/53G06N3/045G06F18/253
Inventor 吕蕾谢锦阳顾玲玉陈梓铭张金玲
Owner SHANDONG NORMAL UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products