Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study introduces a multiview EEG representation learning framework that enhances the alignment of brain responses with visual semantics for zero-shot visual decoding. By integrating input-conditioned temporal dynamics, wavelet-based spectral decomposition, and attention-modulated graph learning, the method effectively captures the complex structure of visual perception from EEG data. The approach achieves state-of-the-art performance on the THINGS-EEG benchmark, demonstrating significant improvements in both within-subject and cross-subject visual classification tasks.
Explicitly modeling multiview neural structures boosts EEG-based visual decoding accuracy, achieving 54.8% Top-1 performance in zero-shot classification.
Zero-shot visual decoding from electroencephalography (EEG) aims to infer visual semantics from non-invasive neural recordings, but remains challenging due to the low signal-to-noise ratio, non-stationarity, and limited spatial resolution of EEG. Existing EEG-vision alignment methods often rely on holistic EEG embeddings, which can obscure the complementary temporal, spectral, and spatial structure underlying visual perception. We introduce a unified multiview EEG representation learning framework for aligning brain responses with visual semantic embeddings. Our method builds an EEG encoder that jointly models three complementary views: input-conditioned state-space temporal dynamics, learnable wavelet-based spectral decomposition for sample-adaptive frequency modeling, and attention-modulated graph learning for structured electrode interactions. The resulting multiview EEG embeddings are fused and aligned with pretrained visual representations in a shared semantic space using contrastive learning with EEG-specific regularization, enabling 200-way zero-shot visual classification. Experiments on THINGS-EEG benchmark show that our method achieves state-of-the-art performance, with 54.8% Top-1 and 85.6% Top-5 accuracy in the within-subject setting and 15.3% Top-1 and 45.4% Top-5 accuracy in the cross-subject setting. We further present the first systematic cross-session EEG-image decoding evaluation, achieving 40.8% Top-1 and 78.0% Top-5 accuracy. These results suggest that explicitly modeling multiview neural structure improves both semantic alignment and generalization in EEG-based visual decoding.