Search papers, labs, and topics across Lattice.
This paper introduces Phrase-Localized Language-Contrastive Guidance (LCG), a training-free framework designed to enhance the accuracy of accent reproduction in code-switched text-to-speech synthesis. By employing a self-attention probing technique to identify phrase boundaries, LCG applies localized language guidance, allowing each segment of speech to reflect its native accent. The results demonstrate a significant improvement in the nativeness of code-switched phrases across various language pairs, while maintaining speaker identity and naturalness without the need for additional training or models.
Code-switched phrases can now be spoken with their native accents without any training, thanks to a novel localized guidance approach that identifies phrase boundaries in real-time.
Current speech synthesis struggles with code-switching, which mixes a foreign language phrase into a primary language utterance, causing the phrase to be spoken with the primary language's accent rather than its native one. We propose Phrase-Localized Language-Contrastive Guidance (LCG), a training-free inference framework that restores a native accent to code-switched phrases in cross-lingual text-to-speech. LCG replaces the single language guidance applied across the whole utterance with a separate guidance for each region, so each part is guided by its own language. To choose where to apply this localized guidance, we propose a self-attention probing technique that finds the phrase boundaries without external alignments. Together, these components generate speech in which each region carries the accent of its own language, requiring no fine-tuning or auxiliary models. Across diverse language pairs, LCG robustly increases the nativeness of the code-switched phrase while suppressing accent leakage, and preserving overall speaker identity and naturalness.
