Search papers, labs, and topics across Lattice.
RobustSeiz is an open-source framework designed to benchmark the robustness of EEG seizure detection models against real-world variability and adversarial inputs. By standardizing four public scalp-EEG datasets into BIDS-EEG trees and implementing a comprehensive evaluation protocol, the framework allows for the assessment of model performance under clinically relevant distribution shifts. The results indicate that perturbation severity significantly impacts detection quality and predictive agreement, highlighting the necessity for robustness beyond traditional accuracy metrics before deployment.
Seizure detectors may perform well on clean data but can falter dramatically under real-world conditions, revealing a critical gap in pre-deployment assessments.
Despite strong performance on held-out electroencephalography (EEG) data, seizure detectors may fail under real-world acquisition variability, artifacts, and adversarial inputs. We introduce RobustSeiz, an open-source, model-agnostic framework that provides a standardized, reproducible protocol for stress-testing and comparing seizure detectors under controlled, clinically motivated distribution shifts before deployment. We standardize four public scalp-EEG corpora (CHB-MIT, TUSZ, Siena, and SeizeIT1) into BIDS-EEG trees and evaluate subject-independent detectors on held-out splits. Environment, noise, and adversarial transforms are swept over predefined hyperparameter grids. Each run reports sample- and event-level sensitivity, precision, F1, false positives per 24 h, Lead and Lag onset timing, and Monte Carlo dropout predictive agreement. RobustSeiz includes a Dockerized GPU pipeline, experiment registry, and full-evaluation and research-subset modes. We demonstrate the framework with a contemporary seizure detector on TUSZ across the complete implemented shift grid; an AWGN analysis illustrates how perturbation severity changes detection quality, onset timing, and predictive agreement. RobustSeiz provides a shared benchmarking standard for evaluating seizure-detector robustness under realistic clinical stressors, extending pre-deployment assessment beyond clean-data accuracy.
