Search papers, labs, and topics across Lattice.
This paper establishes a benchmark for out-of-distribution (OOD) detection in electroencephalography (EEG) machine learning models, addressing their vulnerability to distribution shifts in high-risk environments. By evaluating various OOD detection methods and their impact on clinical prediction tasks, the authors disentangle the often-confused concepts of OOD detection and model uncertainty estimation. The findings reveal that integrating complementary methods enhances the reliability of EEG-based models, providing a robust safety framework for real-world applications.
OOD detection methods can significantly improve the reliability of EEG machine learning models in high-stakes environments, but their effectiveness is often underestimated.
Machine learning models for electroencephalography (EEG) analysis show great promise across a wide range of applications, but their deployment in high-risk domains is hindered by their vulnerability to distribution shifts. Encountering out-of-distribution (OOD) data can lead to catastrophic, overconfident predictive failures. While OOD detection methods can mitigate these risks, they remain heavily under-explored for EEG. Moreover, evaluations in the broader literature typically evaluate OOD detection performance in isolation, ignoring their practical impact on downstream applications. To bridge this gap, we introduce a benchmark for EEG OOD detection, evaluate a broad range of methods, and furthermore evaluate their value in two clinical downstream prediction task. Our results disentangle OOD detection and model uncertainty estimation capabilities, which are frequently conflated in the literature, provide actionable insights about the current state of the art for EEG OOD detection and model uncertainty estimation, and demonstrate how complementary methods for both aspects can be combined to form a robust safety net for the deployment of EEG-based machine learning models in real-world applications.
