Pedestrian monitoring method and device based on intelligent three-dimensional monitoring equipment

Abstract

The invention discloses a pedestrian monitoring method and device based on intelligent three-dimensional monitoring equipment. The pedestrian monitoring method comprises the following steps: acquiring two pedestrian images with different visual angles in the same scene, calculating by using a stereo matching algorithm to obtain a depth image, respectively taking the depth image and a reference color image as the input of a shallow layer network and a deep layer network, constructing a pedestrian detection network based on convolution feature fusion, and obtaining a pedestrian detection result; carrying out collected audio information, abnormal event keyword sentence recognition by adopting a speech recognition algorithm; and intercepting continuous frames of images according to the keyword sentence recognition result and the audio image synchronous calibration result, performing time domain association representation on fusion features of the continuous frames of images by adopting an LSTM algorithm, and performing passenger flow state and event judgment by adopting a softmax classifier after feature mapping in a full connection mode. The device adopting the algorithm comprises a video image processing and central control unit, a cache module, a storage module, an encryption chip, a network transmission module, a USB interface and a power module.

Description

technical field [0001] The invention belongs to the field of intelligent detection, in particular to a pedestrian monitoring method and device based on intelligent three-dimensional monitoring equipment. Background technique [0002] Pedestrian detection technology is widely used in pedestrian analysis, intelligent monitoring, passenger flow statistics, security and other fields. The applicable scenarios include: schools, subway stations, squares, shopping malls, parking lots, parks and other important places and densely populated areas. It can realize functions such as real-time detection of pedestrians, extraction of individual characteristics and group characteristics and parameters, and can provide data acquisition means for systems such as movement situation analysis based on pedestrian detection, large-scale data collection, abnormal event analysis, passenger flow analysis and early warning, etc. On the basis of the traditional video monitoring that only uses color vid...

AI Technical Summary

Problems solved by technology

Another type of system uses the method of deep learning. Although this type of method reduces the influence of different pedestrian postures through large sample data training, it is still susceptible to interference from factors such as lighting conditions and background conditions, especially in complex or high-level environments. In the case of dense crowd flow, the detection accuracy is low

This further affects the accuracy of abnormal event discrimination

Images