Driver and passenger state detection method and device and computer readable storage medium

Abstract

The invention provides a driver and passenger state detection method, which comprises the following steps: acquiring a driver and passenger face image, and extracting feature information of the driver and passenger face image by using a preset multi-layer convolution algorithm, the feature information comprising an image optical flow and an image feature; fusing the extracted feature information with the feature information of the previous frame of driver and conductor face image, and confirming the operation state of the driver and conductor according to a fusion result; and when it is confirmed that the operation state of the driver and the conductor is abnormal, outputting voice reminding information. The invention further discloses a driver and conductor state detection device and a computer readable storage medium, the interference of light on image acquisition is avoided by adopting digital high-definition and ISP image processing technologies, the image acquisition speed and processing efficiency are improved through an edge end computing technology, the working state of the driver and the conductor can be quickly determined, and the working efficiency of the driver and the conductor is improved. And the driving safety is improved.

Description

technical field [0001] The invention relates to the field of driving safety monitoring, in particular to a method, device and computer-readable storage medium for detecting the state of drivers and passengers. Background technique [0002] With the rapid development of my country's railways, the issue of railway transportation safety is an eternal theme of modern transportation, and has been paid more and more attention. The locomotive crew plays a central role in the operation of the locomotive. He directly determines whether the train can run normally. They are the key to ensure the safe operation of a train. It is very important to keep them focused while driving, and not let their poor mental state threaten the normal operation of the train. Therefore, the safety management of the locomotive crew has become a top priority. In terms of locomotive crew safety management, standardization requirements are formulated for the operation standards of safety-critical items in t...

AI Technical Summary

Problems solved by technology

[0003] The main purpose of the present invention is to provide a method, device, and computer-readable storage medium for detecting and alerting drivers and passengers, which solves the problems that may be caused by the working conditions of the locomotive crew due to lack of energy, vision deviation, dozing off, intermittent lookout, etc. during the driving process. Technical issues of potential safety issues

Images