Search papers, labs, and topics across Lattice.
This paper investigates personalized driver state modeling using non-intrusive physiological sensing in real-world automated driving scenarios. They transformed physiological signals from an Empatica E4 wearable into 2D representations and processed them using a multimodal ResNet50-based architecture. Results show that personalized models achieve significantly higher accuracy (92.68%) in predicting driver awareness compared to generalized models (54%), highlighting the importance of accounting for inter-individual variability.
Off-the-shelf driver monitoring systems that ignore individual physiology are doomed to fail, with accuracy plummeting from 93% to 54% when applied across different drivers.
In vehicles with partial or conditional driving automation (SAE Levels 2-3), the driver remains responsible for supervising the system and responding to take-over requests. Therefore, reliable driver monitoring is essential for safe human-automation collaboration. However, most existing Driver Monitoring Systems rely on generalized models that ignore individual physiological variability. In this study, we examine the feasibility of personalized driver state modeling using non-intrusive physiological sensing during real-world automated driving. We conducted experiments in an SAE Level 2 vehicle using an Empatica E4 wearable sensor to capture multimodal physiological signals, including electrodermal activity, heart rate, temperature, and motion data. To leverage deep learning architectures designed for images, we transformed the physiological signals into two-dimensional representations and processed them using a multimodal architecture based on pre-trained ResNet50 feature extractors. Experiments across four drivers demonstrate substantial interindividual variability in physiological patterns related to driver awareness. Personalized models achieved an average accuracy of 92.68%, whereas generalized models trained on multiple users dropped to an accuracy of 54%, revealing substantial limitations in cross-user generalization. These results underscore the necessity of adaptive, personalized driver monitoring systems for future automated vehicles and imply that autonomous systems should adapt to each driver's unique physiological profile.
