Search papers, labs, and topics across Lattice.
This study investigates the effectiveness of various temporal feature extraction strategies within EEG foundation models, comparing a linear baseline, a convolutional encoder, and a frozen pretrained time-series model (MOMENT). The evaluation focuses on two downstream tasks: motor imagery and emotion recognition, revealing that simpler temporal representations excel in motor imagery, while richer models enhance performance in emotion recognition. Notably, the pretrained TSFM demonstrates its utility as a transferable feature extractor, indicating that general-purpose time-series models can effectively contribute to EEG analysis despite not being specifically designed for it.
Pretrained time-series models can significantly enhance EEG analysis, even when used as frozen feature extractors.
Electroencephalography (EEG) foundation models aim to learn generalizable representations from large-scale brain recordings. However, the role of temporal feature extractors and whether pretrained time-series foundation models (TSFMs) can be effectively transferred to this setting remains underexplored. We conduct a controlled comparison of three temporal feature extraction strategies, including a linear baseline, a convolutional encoder, and a frozen pretrained TSFM (MOMENT), within a unified EEG foundation model. We evaluate their impact on representation quality using two downstream tasks: motor imagery and emotion recognition. Results reveal different trends across the evaluated benchmarks. On the motor imagery dataset, simple temporal representations perform competitively, whereas the emotion dataset benefits from richer temporal modeling. Although not specifically adapted to EEG, the pretrained TSFM serves as an effective temporal feature extractor, suggesting that general-purpose time-series representations can be transferred as frozen temporal feature extractors within EEG foundation models.
