Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces CrossAccent-TTS, a novel framework for cross-lingual text-to-speech that allows for controllable accent conversion while preserving speaker identity, addressing significant challenges in low-resource Indic languages. The framework incorporates an Accent Intensity Controller (AIC) that utilizes weighted language embeddings to facilitate smooth accent interpolation and fine-tuned accent intensity modulation during inference. Experimental results demonstrate that CrossAccent-TTS not only enhances accent similarity and controllability but also maintains speaker naturalness, outperforming existing strong baselines on the Indic Multilingual and L2-arctic datasets.
Achieving precise control over accent intensity in TTS systems could revolutionize speech synthesis for low-resource languages.
Accent conversion and controllability remain fundamental challenges in cross-lingual text-to-speech (TTS), particularly for low-resource and phonetically diverse Indic languages. While recent large language model (LLM)-based TTS systems exhibit strong cross-lingual generalization, they provide limited explicit control over accent characteristics and intensity. In this paper, we propose CrossAccentTTS, a framework that enables both accent control and conversion while preserving speaker identity. Specifically, we introduce an Accent Intensity Controller (AIC) that injects weighted language embeddings into the accent subspace, allowing smooth interpolation between accents and fine-grained modulation of accent strength at inference time. Experiments on the Indic Multilingual and L2-arctic datasets shows that CrossAccent-TTS achieves precise control of accent intensity, outperforming strong baselines in accent similarity and controllability by maintaining speaker similarity and naturalness.