Search papers, labs, and topics across Lattice.
The paper introduces X2Streaming-TTS, a novel causal text-to-speech (TTS) framework designed for true token-level synthesis in low-latency spoken dialogue systems. By employing causal commitment and speech-state inheritance, the system effectively manages uncertain prefixes and preserves acoustic continuity across segments without accessing future input. Experimental results demonstrate that X2Streaming-TTS significantly outperforms existing pseudo-streaming models in both subjective and objective metrics, achieving rapid response times while maintaining high audio quality.
X2Streaming-TTS achieves true token-level synthesis with a median time to first audio token of just 15.8 ms, outperforming traditional pseudo-streaming models in quality and responsiveness.
Streaming text-to-speech is essential for low-latency spoken dialogue systems, yet many systems wait for sentence-level text and are therefore only pseudo-streaming. True token-level synthesis must generate speech from uncertain prefixes while maintaining perceptual continuity over an unbounded stream with bounded context. We present X2Streaming-TTS, a causal TTS framework that consumes asynchronously arriving text tokens and emits speech without accessing future input. To handle uncertain prefixes, we introduce causal commitment, which keeps ambiguous expressions provisional through uncertainty-aware buffering and performs capacity-adaptive, punctuation-aware segmentation. To preserve acoustic continuity, we further introduce causal speech-state inheritance, which carries the complete Code2Wav state and selected historical Talker states across segment boundaries. Together with an attention prior constraint, it blocks access to future positions while retaining bounded acoustic context. Experiments show that X2Streaming-TTS outperforms existing pseudo-streaming models on most subjective and objective metrics. Further analysis shows that causal commitment stabilizes online segmentation and reduces failures caused by insufficient context, while speech-state inheritance improves boundary continuity without degrading naturalness or speaker identity. X2Streaming-TTS thus achieves strict token-level synthesis with quality comparable to the evaluated offline baselines, a median time to first audio token (TTFT) of 15.8 ms for a single request, and a median TTFT of 260.8 ms at 128 concurrent requests. Our implementation is publicly available at https://github.com/X-Square-Robot/X2Streaming-TTS .
