A driver abnormal posture monitoring method based on reinforcement learning

Abstract

The invention discloses a driver abnormal posture monitoring method based on reinforcement learning. The method comprises the steps that after a driver driving video is acquired, driver face key points and skeleton key points which are far smaller than image pixel points in number are extracted through an OpenPose system, meanwhile, the face key points are subjected to spline interpolation for three times to construct face characteristics, and driver identity recognition is carried out. According to the key frame extraction method, based on a reinforcement learning mode, a corresponding rewardis obtained through an attitude detection model, and an action value function is updated according to each action of the reward and an attitude until a stable key frame extraction strategy suitable for each driver is obtained. Based on the driver dynamic behavior with time and space changes, a machine learning algorithm is used for training to obtain a posture detection model. And a safety earlywarning mechanism with a guiding property is established in combination with a protection motive theory. According to the invention, the real-time performance and accuracy of detection are improved, and the reliability of safety early warning is enhanced.

Description

technical field [0001] The invention belongs to the technical field of safe driving detection, and in particular relates to a method for monitoring abnormal posture of drivers based on reinforcement learning. Background technique [0002] As a means of transportation, the car has become an indispensable necessities of life. With the rapid growth of the number of private cars and commercial vehicles, it is of great significance to detect and warn the driver's driving behavior to reduce traffic accidents. [0003] Driving behaviors are divided into two categories: the state of the driver inside the vehicle and the state of the vehicle outside the vehicle. The research on driver behavior detection is divided into two categories: the traditional sensor-based wearable detection method, which not only causes interference to the driver, but also has high equipment cost; the mainstream detection method is the detection method based on monocular camera , the method obtains a large ...

AI Technical Summary

Problems solved by technology

[0004] However, the driver behavior research based on the monocular camera still needs to solve the following problems: for some reasons, the images captured by the on-board camera are not clear, which will cause some changes in the extracted driver's physical characteristics, and the traditional detection results will be confused. ; In most cases, when training the model, an image or even an image sequence is used as input, which will require a lot of time and resources to train the detection model. The amount of video data is too large to achieve real-time effects; most of the current detection models are trained based on big data, often considering the general characteristics of ordinary drivers' driving behaviors, while ignoring the behavior characteristics of different drivers

This method needs to collect a large amount of data in defined scenarios for training, and the emerging dangerous driving behavior cannot be recognized or the recognition accuracy is low; if all scenarios are defined and details are detected, the range of use of the model is limited; and based on The model training method of universal features does not consider the action characteristics of different drivers, which will cause deviations in detection or untimely detection results

[0006] At present, there is no method to detect the driver's normal driving behavior, bad driving behavior (calling, drinking water, looking at the mobile phone, etc.) and dangerous driving behavior (fainting, etc.) based on reinforcement learning and key point information of human bones. problem, this method proposes a driver behavior detection method based on reinforcement learning to correctly identify and warn potential dangerous driving behaviors

Images