Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A driver state monitoring method and system based on visual information fusion

A technology of driver status and visual information, applied in the field of traffic engineering, can solve problems such as normal driving interference and low accuracy, and achieve real-time monitoring, improved safety, and fast calculation speed

Inactive Publication Date: 2018-01-23
ZHEJIANG UNIVERSITY OF MEDIA AND COMMUNICATIONS
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] The purpose of the present invention is to provide a driver state monitoring method and system based on visual information fusion to solve the problem that the existing monitoring method is not only low in accuracy, but also easily interferes with normal driving. question

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A driver state monitoring method and system based on visual information fusion
  • A driver state monitoring method and system based on visual information fusion
  • A driver state monitoring method and system based on visual information fusion

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0050] Such as figure 1 As shown, the driver state monitoring method based on visual information fusion includes the following steps:

[0051] S10, collecting and preprocessing the driver's face image and the road image in front of the car.

[0052] Collect real-time images, collect real-time images of the driver's face by setting the infrared camera inside the car (and camera outside the car) collect real-time road images in front of the car, and transmit them to the image processing module for preprocessing. For example, according to the needs of the data format, the acquired The image is converted into a single-channel grayscale image, and operations such as filtering and noise reduction are performed.

[0053] S20, performing face positioning on the preprocessed driver's face image to obtain a face area.

[0054] as attached figure 2 As shown, to obtain the face area and eliminate the influence of hair and other parts on human eye detection, the specific method is as f...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a driver state monitoring method based on vision information fusion and a driver state monitoring system based on vision information fusion. The method comprises steps that: a driver face image and a road image in front of an automobile are acquired, and the images are pre-processed; face positioning on the pre-processed driver face image is carried out to acquire a face area; an eye pupil mass center and a pupil area in the face area are positioned to acquire eye state parameters, and eyes are tracked; track line detection and identification on the pre-processed road image in front of the automobile are carried out; according to a detected track line, an automobile driving direction and a navigation line included angle are calculated to determine whether the automobile deviates from the track; the driving state of the driver is discriminated according to the eye characteristics of the driver and the automobile deviation degree. The driver state monitoring method integrates two computer vision modes, improves detection efficiency, realizes real-time monitoring and alarm when the driver is under abnormal driving states, e.g., fatigue driving, after-drinking driving and driving with disperse attention, and thereby automobile safety driving is guaranteed.

Description

technical field [0001] The invention relates to traffic engineering, in particular to a driver state monitoring method and system based on visual information fusion. Background technique [0002] Drivers in an abnormal driving state can easily lead to road traffic accidents, so a safe and reliable vehicle driver status real-time monitoring system has far-reaching significance. [0003] At present, the existing driver state monitoring technology generally has the following methods: 1. The method based on the driver's physiological phenomenon; 2. The method based on the driver's manipulation behavior; 3. The method based on the behavior of the car; among them: [0004] The method based on the driver's physiological phenomenon mainly realizes the driver's status by measuring the driver's physiological signals such as heart rate, pulse, brain wave, electromyographic signal and other parameters changes or body movements including facial expressions, blinking frequency and other p...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06K9/00G06K9/62
Inventor 张根源虞勤杨思思周泓
Owner ZHEJIANG UNIVERSITY OF MEDIA AND COMMUNICATIONS
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products