The invention discloses a
pedestrian monitoring method and device based on intelligent three-dimensional monitoring equipment. The
pedestrian monitoring method comprises the following steps: acquiring two
pedestrian images with different visual angles in the same scene, calculating by using a
stereo matching algorithm to obtain a depth image, respectively taking the depth image and a reference
color image as the input of a shallow layer network and a deep layer network, constructing a
pedestrian detection network based on
convolution feature fusion, and obtaining a
pedestrian detection result; carrying out collected audio information, abnormal event keyword
sentence recognition by adopting a
speech recognition algorithm; and intercepting continuous frames of images according to the keyword
sentence recognition result and the audio image synchronous
calibration result, performing
time domain association representation on fusion features of the continuous frames of images by adopting an LSTM
algorithm, and performing passenger flow state and event judgment by adopting a softmax classifier after
feature mapping in a full connection mode. The device adopting the algorithm comprises a
video image processing and central
control unit, a cache module, a storage module, an
encryption chip, a network transmission module, a
USB interface and a
power module.