Search papers, labs, and topics across Lattice.
This paper introduces CuteTTS, a continuous-autoregressive text-to-speech (TTS) system designed to optimize both synthesis quality and inference speed. By integrating semantically aligned causal VAE latents with patch-level autoregression and a bidirectional flow-matching head, CuteTTS achieves high intelligibility and speaker similarity in zero-shot voice cloning. The method's innovative guidance-step distillation reduces first-audio latency by 23.3% and real-time factor by 40.8%, making it a significant advancement for low-latency TTS applications.
Achieving high-fidelity speech synthesis with a 40.8% reduction in real-time processing time could revolutionize interactive voice applications.
Zero-shot text-to-speech (TTS) now supports interactive assistants, personalized media, and accessibility tools. All TTS systems require faithful linguistic rendering, consistent speaker identity, and low-latency response. Yet compact streaming systems must preserve sufficient acoustic detail in a predictable low-rate latent sequence, while iterative diffusion sampling and classifier-free guidance multiply inference cost at every autoregressive step. To strike a balance between high-fidelity synthesis and low-latency inference, we present CuteTTS, a compact continuous-autoregressive TTS system. It combines semantically aligned causal VAE latents with patch-level autoregression, explicit speaker conditioning, and a bidirectional flow-matching head. We further introduce guidance-step distillation, which absorbs classifier-free guidance and multiple solver steps into a single interval-conditioned student. Evaluations on LibriSpeech and Seed-TTS-Eval demonstrate competitive intelligibility and speaker similarity in zero-shot voice cloning, while distillation lowers first-audio latency by 23.3% and real-time factor by 40.8% relative to the base model with comparable objective and subjective quality. These results provide a practical path toward continuous-autoregressive TTS that reconciles high-fidelity generation with the latency demands of real-time interaction.
