Search papers, labs, and topics across Lattice.
This paper investigates how different types of Artificial Neural Network (ANN) representations, specifically acoustic and expectation-related, can be used as teacher signals to improve EEG-based music identification. The key finding is that pretraining EEG models to predict either acoustic or expectation-related ANN representations significantly outperforms non-pretrained baselines, and combining both representations leads to further improvements. This demonstrates that the type of teacher representation used in pretraining shapes downstream EEG decoding performance and highlights the potential of representation learning guided by neural encoding principles.
Separating acoustic and expectation-related representations in neural networks unlocks better EEG-based music identification, outperforming even strong ensembles.
During music listening, cortical activity encodes both acoustic and expectation-related information. Prior work has shown that ANN representations resemble cortical representations and can serve as supervisory signals for EEG recognition. Here we show that distinguishing acoustic and expectation-related ANN representations as teacher targets improves EEG-based music identification. Models pretrained to predict either representation outperform non-pretrained baselines, and combining them yields complementary gains that exceed strong seed ensembles formed by varying random initializations. These findings show that teacher representation type shapes downstream performance and that representation learning can be guided by neural encoding. This work points toward advances in predictive music cognition and neural decoding. Our expectation representation, computed directly from raw signals without manual labels, reflects predictive structure beyond onset or pitch, enabling investigation of multilayer predictive encoding across diverse stimuli. Its scalability to large, diverse datasets further suggests potential for developing general-purpose EEG models grounded in cortical encoding principles.
