Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study addresses the issue of shortcut learning in EEG-guided target speech extraction by introducing TRUST-TSE, a two-stage training framework that enhances generalization across trials. The method employs contrastive pretraining with attended-speaker negative sampling to refine EEG-speech alignment while minimizing reliance on trial-specific cues. Experimental results demonstrate that TRUST-TSE significantly outperforms existing end-to-end models in cross-trial scenarios, highlighting its effectiveness in improving reliability in neuro-steered hearing technologies.
Shortcut learning in EEG models can be effectively mitigated, leading to superior generalization across unseen trials.
Recent end-to-end models for EEG-guided target speech extraction report impressive results, underscoring potential for neuro-steered hearing technologies. However, our analysis reveals that high within-trial performance can be driven by trial-specific EEG structure that acts as shortcuts for target selection, leading to poor generalization on unseen trials. To overcome this gap, we propose TRUST-TSE, a two-stage framework to mitigate shortcut learning. By introducing contrastive pretraining with attended-speaker negative sampling, we encourage the EEG encoder to capture fine-grained EEG--speech alignment while suppressing trial-identity cues. We also employ a confidence-weighted extraction objective based on EEG--source similarity to guide extraction using the learned representations. Experiments on KUL and DTU datasets show that TRUST-TSE outperforms end-to-end baselines under strict cross-trial protocols, addressing a key reliability bottleneck of existing approaches.