Search papers, labs, and topics across Lattice.
This paper introduces L-Proto, a novel training strategy designed to enhance multilingual speaker verification by addressing the entanglement of speaker identity with language-specific acoustic features. By constructing language-consistent episodes that sample speakers from a single language, L-Proto effectively reduces language-driven variability, allowing embeddings to concentrate on speaker identity. Experimental results on the TidyVoice Challenge benchmark reveal that L-Proto consistently outperforms traditional fine-tuning and random episodic sampling methods across various backbone architectures.
Language-aware episodic training can significantly enhance speaker verification performance by disentangling speaker identity from language-specific features.
Multilingual speaker verification remains challenging because language-dependent acoustic variability causes speaker identity to become entangled with linguistic characteristics, degrading generalization across languages. In multilingual training, embeddings often encode language cues with speaker identity, causing speakers to form language-specific clusters. We propose L-Proto, a language-aware episodic prototypical training strategy that constructs language-consistent episodes. By sampling speakers from a single language per episode, L-Proto reduces language-driven variation during training and encourages embeddings to focus more directly on speaker identity. Experiments on the TidyVoice Challenge benchmark demonstrate consistent performance improvements over conventional fine-tuning and random episodic sampling across multiple backbone architectures.
