Driver State and Why It's Crucial in the Active Safety
Yanuar Tri Aditya Nugraha
yanuart.adityan[at]gmail.com
version 0.0.1
Sensor Performance Responsible, Driver Monitoring System
Sensor A/V, Front Looking Camera
Sensor A/V, CADS4
Thesis student, Sensor A/V Autonomous Drive
Computer Systems & Networks, Chalmers
2016 - now, VCC
2014 - 2016
Expedition Leader
T1/T2 Hällered Proving Ground
How good are you behind the steering wheels?
"When it comes to driving, most people think they are much better in it than they really are"
Roy, M. M., Liersch, M. J. (2014). I am a better driver than you think: examining self-enhancement for driving ability.
Journal of Applied Social Psychology, 43(8), 1648–1659.
Decisions making
Dangerous behaviours
Driver support system
Driver monitoring
DRIVER DECISIONS
Cognition
Judgment
Action
Cognition
Judgment
Action
Field of View
Tasks
Traffic
Physical
High Mental
Workload
Stress
Uneven Work
Hours
Night Driving
Insufficient Visual Performance
Cognitive Distraction
Close-Range Following
High Speed Driving
Drowsiness &
Microsleep
Missed Speed Limit Sign
Manoeuvre Without Enough Space
Misjudged Relative Speed/Distance
Late Awareness of Slower Vehicle
Lost Control of the Vehicle
Un-intentional Lane Departure
Vulnerable
Road Users Accident
Forward
Collision
Side Vehicle
Collision
Road Departure Accident
time to collision
Field of View
Tasks
Traffic
Physical
High Mental
Workload
Stress
Uneven Work
Hours
Night Driving
Insufficient Visual Performance
Cognitive Distraction
Close-Range Following
High Speed Driving
Drowsiness &
Microsleep
Missed Speed Limit Sign
Manoeuvre Without Enough Space
Misjudged Relative Speed/Distance
Late Awareness of Slower Vehicle
Lost Control of the Vehicle
Un-intentional Lane Departure
Vulnerable
Road Users Accident
Forward
Collision
Side Vehicle
Collision
Road Departure Accident
time to collision
Field of View
Tasks
Traffic
Physical
High Mental
Workload
Stress
Uneven Work
Hours
Night Driving
Insufficient Visual Performance
Cognitive Distraction
Close-Range Following
High Speed Driving
Drowsiness &
Microsleep
Missed Speed Limit Sign
Manoeuvre Without Enough Space
Misjudged Relative Speed/Distance
Late Awareness of Slower Vehicle
Lost Control of the Vehicle
Un-intentional Lane Departure
Vulnerable
Road Users Accident
Forward
Collision
Side Vehicle
Collision
Road Departure Accident
time to collision
Field of View
Tasks
Traffic
Physical
High Mental
Workload
Stress
Uneven Work
Hours
Night Driving
Insufficient Visual Performance
Cognitive Distraction
Close-Range Following
High Speed Driving
Drowsiness &
Microsleep
Missed Speed Limit Sign
Manoeuvre Without Enough Space
Misjudged Relative Speed/Distance
Late Awareness of Slower Vehicle
Lost Control of the Vehicle
Un-intentional Lane Departure
Vulnerable
Road Users Accident
Forward
Collision
Side Vehicle
Collision
Road Departure Accident
time to collision
DRIVER SUPPORT SYSTEM
perception
localization
risk handling
intervention
Cognition
Judgment
Action
risk handling
intervention
Cognition
Judgment
Action
perception
localization
| fr tracklets | fr objects | tracking | lanemark | rs tracklets | depth | |
|---|---|---|---|---|---|---|
| collision warning | yes | |||||
| blis | yes | yes | ||||
| aeb | yes | yes | yes | |||
| cruise control | yes | yes | yes | |||
| lane keeping aid | yes | yes | yes | |||
| pilot assist | yes | yes | yes | yes | ||
| AD level 4 | yes | yes | yes | yes | yes | |
| AD level 5 | yes | yes | yes | yes | yes | yes |
radar
camera
lidar
Field of View
Tasks
Traffic
Physical
High Mental
Workload
Stress
Uneven Work
Hours
Night Driving
Insufficient Visual Performance
Cognitive Distraction
Close-Range Following
High Speed Driving
Driver Impairment
Missed Speed Limit Sign
Manoeuvre Without Enough Space
Misjudged Relative Speed/Distance
Late Awareness of Slower Vehicle
Lost Control of the Vehicle
Un-intentional Lane Departure
Vulnerable
Road Users Accident
Forward
Collision
Side Vehicle
Collision
Road Departure Accident
time to collision
collision warning
speed limiter
aeb
cruise control
lane keeping aid
pilot assist
blis
risk handling
intervention
Cognition
Judgment
Action
perception
localization
DANGEROUS BEHAVIOUR
DANGEROUS BEHAVIOURS
INTOXICATION
DISTRACTIONS
IMPAIRMENTS
IMPAIRMENTS
Tired
Drowsiness
Microsleep
| KSS Level | Description |
|---|---|
| 1 | Extremely alert |
| 2 | Very alert |
| 3 | Alert |
| 4 | Fairly alert |
| 5 | Neither alert nor sleepy |
| 6 | Some signs of sleepiness |
| 7 | Sleepy, but no effort to keep alert |
| 8 | Sleepy, some effort to keep alert |
| 9 | Very sleepy, great effort to keep alert, fighting sleep |
Shahid A., Wilkinson K., Marcu S., Shapiro C.M. (2011) Karolinska Sleepiness Scale (KSS). In: Shahid A., Wilkinson K., Marcu S., Shapiro C. (eds) STOP, THAT and One Hundred Other Sleep Scales. Springer, New York, NY
DISTRACTIONS
Psychological factor
Short glance, but often
Checking SMS, Whatsapp
Operating interior console
OEM tends to move to centralised panel
Kircher A, Uddman M, Sandin J (2002). Vehicle control and drowsiness.
VTI medelande 922A, 2002
Driver Monitoring Camera
Ground Truth/Reference
DRIVER MONITORING
Camera based
Monocular
Stereo
Infrared
See through darkness
Head pose
What to look?
Eye position
Eye closure
Eye gaze
DISTRACTIONS
DROWSINESS
IN-CAR
WHEN IS IT READY?
In production, selected OEMs
Mostly monocular camera solution
2020 EURONCAP first test with DMS
2025 EURONCAP full test
SUMMARY
Drive safe, defensive driving is general 'good' driving
The technology is here, but imperfect
Join Volvo!
Active safety is there, but do not over-reliance
Driver State in Active Safety
By Yanuar Tri Aditya Nugraha
