Escalator passenger falling detection algorithm based on deep learning

Abstract

The invention discloses an escalator passenger falling detection algorithm based on deep learning. The method comprises the following steps: 1) collecting a video image that a passenger takes an escalator; 2) detecting a passenger face by using a FHOG describer and a SVM classifier; 3) tracking the passenger face by using KCF, and newly establishing a passenger trajectory list based on the passenger face information; 4) retraining yolo2 algorithm model to detect the passenger body by using migration learning; 5) matching the passenger face and the passenger body, and adding the body information in the trajectory list; 6) extracting a passenger bone joint sequence by using an openpose deep learning algorithm; 7) matching the passenger body with the passenger bone joint sequence, and addingthe bone joint information in the trajectory list; and 8) analyzing the bone joint information in the trajectory list and detecting the passenger falling behavior. Through the algorithm disclosed by the invention, the falling behavior of the passenger taking the escalator can be detected, an emergency scheme can be timely started when discovering the falling behavior, so that the safety hazard canbe reduced to a minimum.

Description

technical field [0001] The present invention relates to the technical field of image processing and behavior recognition, in particular to a deep learning-based detection algorithm for passengers falling down in an escalator. Background technique [0002] With the continuous advancement of my country's modernization process and the continuous improvement of people's economic living standards, more and more public facilities appear in public places to facilitate people's daily production and life. As a public facility that facilitates passengers to travel, escalators are used in shopping malls. It can be seen everywhere in public places such as office buildings, subway stations, etc. However, the convenience of travel has caused a series of safety problems, such as passenger congestion on the escalator, passengers going backwards, passengers running, passengers falling, etc., these Behaviors, especially passenger falls, will cause serious safety accidents. It is necessary to mo...

AI Technical Summary

Problems solved by technology

[0002] With the continuous advancement of my country's modernization process and the continuous improvement of people's economic living standards, more and more public facilities appear in public places to facilitate people's daily production and life. As a public facility that facilitates passengers to travel, escalators are used in shopping malls. It can be seen everywhere in public places such as office buildings, subway stations, etc. However, the convenience of travel has caused a series of safety problems, such as passenger congestion on the escalator, passengers going backwards, passengers running, passengers falling, etc., these Behaviors, especially passenger falls, will cause serious safety accidents. It is necessary to monitor and discover safety problems in time and issue warnings or stop the escalator. At present, the safety problems of escalators are mainly prevented by manually monitoring the escalator area. , but now the labor cost is getting higher and higher, and the repetitive and boring monitoring work is easy to make the staff slack and fail to deal with sudden security incidents in time

Images