Search papers, labs, and topics across Lattice.
This paper identifies a persistent low-frequency bias in EEG representations learned by foundation models, which adversely affects downstream performance regardless of data scale or model capacity. The authors link this bias to the interaction between EEG's $1/f^伪$ spectral structure and neural networks' preference for low-frequency components, exacerbated by the $\ell_2$ reconstruction objective in masked autoencoders. To mitigate this issue, they introduce FAME, a frequency-balanced masked autoencoding framework that standardizes reconstruction targets and balances supervision across EEG bands, leading to state-of-the-art performance on 24 out of 41 evaluated tasks.
Low-frequency bias in EEG models can be corrected, leading to a significant boost in performance across a wide range of tasks.
Increasing EEG pretraining data scale or model capacity does not consistently improve downstream performance. We identify a persistent low-frequency bias in representations learned by diverse EEG foundation models, which remains across dataset scales, model capacities, and pretraining objectives. Our analysis links this bias to the interaction between EEG's $1/f^伪$-like spectral structure and neural networks' tendency to preferentially learn low-frequency components. In masked autoencoders, the $\ell_2$ reconstruction objective further amplifies this imbalance: under comparable relative reconstruction errors, high-power low-frequency components contribute disproportionately to the loss. To address this issue, we introduce FAME, a frequency-balanced masked autoencoding framework that reconstructs time--frequency activity in predefined EEG bands from masked EEG inputs. FAME independently standardizes the reconstruction targets within each band and assigns equal weight to all band-specific losses, thereby balancing supervision across the EEG spectrum. Evaluated on 41 downstream tasks in OmniEEG-Bench, FAME learns more spectrally balanced representations and achieves state-of-the-art performance on 24 of them. These results underscore the importance of balanced spectral supervision for learning transferable EEG representations.
NUS