Search papers, labs, and topics across Lattice.
This study explores parameter-efficient self-supervised adaptation for EEG foundation models, focusing on updating only 9% of parameters to enhance performance across various clinical datasets. The approach was tested on two state-of-the-art models, BIOT and CBraMod, demonstrating significant improvements in abnormality detection, event classification, and seizure detection, achieving up to 20x AUCPR gains over linear probing. Notably, the method maintains peak performance with a fixed computational budget and shows that performance is primarily driven by the diversity of temporal windows rather than the number of patients.
Achieving up to 20x improvements in EEG model performance with just 9% parameter updates could revolutionize clinical applications under tight computational constraints.
EEG foundation models pretrained via self-supervised learning promise transferable representations, but their generalization remains limited, especially across diverse clinical datasets. Full fine-tuning is impractical for resource-constrained clinical settings due to high computational requirements. In this work, we investigate whether parameter-efficient self-supervised adaptation, updating only 9% of parameters suffices to align representations to target tasks. We evaluate our method on two state-of-the-art models with different pretraining objectives: BIOT (contrastive) and CBraMod (masked reconstruction), and evaluate on three clinical EEG datasets for abnormality detection (TUAB), event classification (TUEV), and seizure detection (CHB-MIT) under both in-distribution and out-of-distribution conditions. SSL adaptation yields consistent gains over linear probing, up to 20x AUCPR. Under a fixed compute budget, peak performance requires only 20--50% of available unlabeled data. Critically, when total window count is fixed, performance remains invariant to patient count, suggesting that performance is dependent on overall temporal window diversity only. Our findings demonstrate that parameter-efficient adaptation enables effective deployment of EEG Foundation models (EEG-FM) with minimal computational overhead and data collection burden. Code available at: https://github.com/c3n-group/efficient-eeg-adapt
