Search papers, labs, and topics across Lattice.
The paper introduces MOSAIC, an interpretable multi-token cross-attention framework designed for voice anti-spoofing that enhances the integration of self-supervised learning with biophonetic features. By splitting a 152-dimensional feature vector into six semantic-group query tokens and utilizing a 13-layer WavLM-Large transformer, the model visualizes cue-to-layer interactions, revealing distinct activation patterns for genuine versus spoofed speech. MOSAIC achieves competitive performance with an equal error rate (EER) of 1.93% on ASVspoof 2019 LA, closely approaching the state-of-the-art while maintaining robustness across different datasets.
Visualizing cue-to-layer interactions reveals that biophonetic features are crucial for distinguishing genuine speech from spoofed audio, providing insights into model interpretability.
The dominant trend in voice anti-spoofing fuses self-supervised (SSL) backbones (e.g., WavLM) with handcrafted features, yet such fusion typically lacks transparency in cue-to-layer interactions, and simple concatenation limits cross-modal learning. We propose MOSAIC (Multi-token Oriented Speech Anti-spoofing via Integrated Cross-attention), an interpretable multi-token cross-attention framework that splits a 152-dimensional biophonetic feature vector into six semantic-group query tokens (Praat, phase, LFCC mean/std, sub-band mean/std) and attends them over thirteen mean-std pooled WavLM-Large transformer layers as keys/values. The resulting 6x13 attention matrix visualizes cue-to-layer alignment; a z-score analysis of the per-token activations shows that biophonetic/phase tokens activate more on bona fide speech while spectral/channel tokens activate more on spoofed speech -- yielding per-cue, per-layer attribution that extends prior fusion approaches. Trained jointly with focal loss, a dual LA/PA domain-adversarial classifier, and a bona-fide-only VAE regularizer, MOSAIC attains EER 1.93% / 1.98% on ASVspoof 2019 LA / PA -- a single unified model that approaches the PA-specialized SOTA (LFCC-CMR, 1.34%) while remaining competitive on LA -- and 9.28% / 6.21% / 40.09% on ASVspoof 2021 LA / DF / PA.
