System for achieving fatigue driving judgment on basis of image processing and fusion between heart rate characteristic and expression characteristic

Abstract

The invention discloses a system for achieving fatigue driving judgment on the basis of image processing and fusion between the heart rate characteristic and the expression characteristic. The system comprises an information collection device, an information processing device and an early warning device. The system is characterized in that the information collection device is used for collecting a driver face image sequence, and providing the driver face image sequence for the information processing device; the information processing device is used for carrying out processing and analysis on the collected driver face image sequence to obtain expression characteristic information and heart rate characteristic information of a driver, and carrying out information fusion on the expression characteristic and the heart rate characteristic so that whether the driver is in the fatigue state or not can be judged; the early warning device is used for sending an instruction to an early warning prompting device according to the early warning strategy and the fatigue level when the driver is in fatigue driving, and carrying out prompting and early warning on the driver. According to the system for achieving fatigue driving judgment on the basis of image processing and fusion between the heart rate characteristic and the expression characteristic, the heart rate characteristic and the expression characteristic are combined through an image processing method, a fatigue driving judgment algorithm is achieved, a vehicle-mounted fatigue driving judgment device is obtained, and accuracy, robustness and reliability of the system for achieving fatigue driving judgment are improved.

Description

technical field [0001] The invention belongs to the technical field of intelligent transportation, and in particular relates to a system for realizing fatigue driving discrimination based on image processing and fusion of heart rate features and expression features. Background technique [0002] With the increasing number of automobiles and the improper extension of expressways, the speed of vehicles is getting faster and faster, the situation of road traffic safety is becoming increasingly severe, and automobile traffic accidents are increasing, which not only cause a large number of casualties and huge economic losses, but also lead to many social problems. Surveys show that fatigue driving is one of the most important hidden dangers of traffic safety. When a driver is fatigued, his ability to perceive the surrounding environment, driving judgment ability and ability to control the vehicle are greatly reduced, and traffic accidents are prone to occur. With the enhancement...

AI Technical Summary

Problems solved by technology

[0006] The driver's fatigue state can also be estimated by using vehicle driving state information such as vehicle trajectory changes and lane line deviations, but the driving state of the vehicle is also related to many environmental factors such as vehicle characteristics and roads, and is related to the driver's driving experience and driving habits. Therefore, there are many interference factors that need to be considered in judging fatigue driving based on vehicle state information

[0007] The fatigue driving discrimination method based on the driver's physiological response characteristics refers to the use of the driver's eye characteristics, mouth movement characteristics, etc. to infer the driver's fatigue state. Closing time and yawning actions can be directly used to detect fatigue, but due to certain differences in the habits and characteristics of different drivers, the robustness of judging the driver's state through a single facial expression feature is not high enough

Images