Nonintrusive Detection of Driver Cognitive Distraction in Real Time Using Bayesian Networks

Abstract

Driver distraction has become an important and growing safety concern as the use of in-vehicle information systems (IVISs), such as cell phones and navigation systems, continues to increase. One approach to allowing people to benefit from IVISs without compromising safety is to create adaptive IVISs that adjust their functions according to driver and roadway state. A critical element of adaptive IVISs involves monitoring driver distraction in real time; with such a monitoring function it is possible to mitigate that distraction. This study applied Bayesian networks (BNs), a data mining method, to develop a real-time approach to detecting cognitive distraction using drivers’ eye movements and driving performance. Data were collected in a simulator experiment involving 10 participants who interacted with an IVIS system while driving. BN models were trained and tested to investigate the influence of three model characteristics on distraction detection: time history of driver behavior, inclusion of hidden nodes in the model structure, and how data are summarized and the length of training sequences. Results showed that BNs could identify driver distraction reliably with an average accuracy of 80.1%. Dynamic BNs (DBNs) that consider time dependencies of driver behavior produced more sensitive models than static BNs (SBNs). Longer training sequences improved DBN model performance. Blink frequency and fixation measures were particularly indicative of distraction. These results demonstrate that BNs, especially DBNs, can detect driver cognitive distraction by extracting information from complex behavioral data. Potential applications include the design of adaptive in-vehicle systems and the evaluation of driver distraction.

Get full access to this article

View all access options for this article.

References

Klauer

S. G.

Neale

V. L.

Dingus

T. A.

Ramsey

and Sudweeks

. Driver Inattention: A Contributing Factor to Crashes and Near-Crashes. Presented at 49th Annual Meeting of Human Factors and Ergonomics Society, Orlando, Fla., 2005.

Jamson

A. H.

and Merat

. Surrogate In-Vehicle Information Systems and Driver Behaviour: Effects of Visual and Cognitive Load in Simulated Rural Driving. Transportation Research Part F, Vol. 8, 2005, pp. 79–96.

Alm

and Nilsson

. The Effects of a Mobile Telephone Task on Driver Behaviour in a Car Following Situation. Accident Analysis and Prevention, Vol. 27, No. 5 1995, pp. 707–715.

Pettitt

Burnett

and Stevens

. Defining Driver Distraction. Presented at World Congress on Intelligent Transport Systems, San Francisco, Calif., 2005.

Zhang

Owechko

and Zhang

. Driver Cognitive Workload Estimation: A Data-Driven Perspective. Presented at IEEE Intelligent Transportation Systems Conference, Washington, D.C., 2004.

Wickens

C. D.

Multiple Resources and Performance Prediction. Theoretical Issues in Ergonomics Science, Vol. 3, No. 2 2002, pp. 159–177.

Recarte

M. A.

and Nunes

L. M.

. Effects of Verbal and Spatial-Imagery Tasks on Eye Fixations While Driving. Journal of Experimental Psychology: Applied, Vol. 6, No. 1 2000, pp. 31–43.

Recarte

M. A.

and Nunes

L. M.

. Mental Workload While Driving: Effects on Visual Search, Discrimination, and Decision Making. Journal of Experimental Psychology: Applied, Vol. 9, No. 2 2003, pp. 119–137.

Victor

T. W.

Keeping Eye and Mind on the Road. Uppsala Universitet, Uppsala, Sweden, 2005, pp. 84.

10.

Strayer

D. L.

Drews

F. A.

and Johnston

W. A.

. Cell Phone-Induced Failures of Visual Attention During Simulated Driving. Journal of Experimental Psychology: Applied, Vol. 9, No. 1 2003, pp. 23–32.

11.

Horrey

W. J.

and Wickens

C. D.

. Examining the Impact of Cell Phone Conversations on Driving Using Meta-Analytic Techniques. Human Factors, Vol. 48, No. 1 2006, pp. 196–205.

12.

Lee

J. D.

Caven

Haake

and Brown

T. L.

. Speech-Based Interaction with In-Vehicle Computers: The Effect of Speech-Based E-Mail on Drivers’ Attention to the Roadway. Human Factors, Vol. 43, No. 4 2001, pp. 631–640.

13.

Lamble

Kauranen

Laakso

and Summala

. Cognitive Load and Detection Thresholds in Car Following Situations: Safety Implications for Using Mobile (Cellular) Telephones While Driving. Accident Analysis and Prevention, Vol. 31, No., 1999, pp. 617–623.

14.

Strayer

D. L.

and Johnston

W. A.

. Driven to Distraction: Dual-Task Studies of Simulated Driving and Conversing on a Cellular Telephone. Psychological Science, Vol. 12, No. 6 2001, pp. 462–466.

15.

Sodhi

Reimer

and Llamazares

. Glance Analysis of Driver Eye Movements to Evaluate Distraction. Behavior Research Methods Instruments and Computers, Vol. 34, No. 4 2002, pp. 529–538.

16.

Victor

T. W.

Harbluk

J. L.

and Engstrom

J. A.

. Sensitivity of Eye-Movement Measures to In-Vehicle Task Difficulty. Transportation Research Part F, Vol. 8, 2005, pp. 167–190.

17.

Tan

P.-N.

Introduction to Data Mining. Pearson Addison Wesley, Boston, Mass., 2005.

18.

Baldi

and Brunak

. Bioinformatics: The Machine Learning Approach, 2nd ed. MIT Press, Cambridge, Mass., 2001.

19.

and Ji

. Active Affective State Detection and User Assistance with Dynamic Bayesian Networks. IEEE Transactions on Systems, Man, and Cybernetics—Part A: Systems and Humans, Vol. 35, No. 1 2005, pp. 93–105.

20.

Zhu

and Lan

. Real-Time Nonintrusive Monitoring and Prediction of Driver Fatigue. IEEE Transactions on Vehicle Technology, Vol. 53, No. 4 2004, pp. 1052–1068.

21.

Guhe

Liao

Zhu

Gray

W. D.

and Schoelles

M. J.

. Non-Intrusive Measurement of Workload in Real-Time. Presented at 49th Annual Meeting of the Human Factors and Ergonomics Society, Orlando, Fla., 2005.

22.

Kumagai

and Akamatsu

. Prediction of Human Driving Behavior Using Dynamic Bayesian Networks. IEICE Transactions on Information and Systems, Vol. E89-D, No. 2, 2006, pp. 857–860.

23.

Liang

Reyes

M. L.

and Lee

J. D.

. Real-Time Detection of Driver Cognitive Distraction Using Support Vector Machines. IEEE Transactions on Intelligent Transportation Systems, Vol. 8, No. 2, pp. 340–350.

24.

Nakayama

Futami

Nakamura

and Boer

E. R.

. Development of a Steering Entropy Method for Evaluating Driver Workload. SAE Technical Paper 1999–01–0892. Presented at International Congress and Exposition, Detroit, Mich., March 1–4, 1999.

25.

Murphy

M. P.

The Bayes Net Toolbox. bnt.sourceforge.net. Last update June 9, 2004.

26.

LeRay

The Bnt Structure Learning Package V.1.4. banquiseasi.insa-rouen.fr/projects/bnt-slp/. Last update May 20, 2005.

27.

Stanislaw

and Todorov

. Calculation of Signal Detection Theory Measures. Behavior Research Methods Instruments & Computers, Vol. 31, No. 1 1999, pp. 137–149.

28.

Veltman

J. A.

and Gaillard

A. W. K.

. Physiological Workload Reactions to Increasing Levels of Task Difficulty. Ergonomics, Vol. 41, No. 5 1998, pp. 656–669.

29.

Donmez

Boyle

and Lee

J. D.

. Taxonomy of Mitigation Strategies for Driver Distraction. Presented at 47th Annual Meeting of the Human Factors and Ergonomics Society, Denver, Colo., 2003.