Search papers, labs, and topics across Lattice.
This paper introduces FlowTTS-GRPO, an online reinforcement learning framework tailored for Flow-Matching (FM) based text-to-speech systems, addressing a gap in existing RL research that primarily focuses on large language models. By transforming ordinary differential equation trajectories into stochastic differential equation paths, the authors enable efficient fine-tuning of open-source FM models without the need for auxiliary models. Key findings reveal that a weighted reward combination leads to faster convergence compared to probabilistic schemes, while optimizations such as omitting classifier-free guidance and synthesizing challenging cases significantly enhance audio quality metrics and user preferences in TTS outputs.
A novel RL framework for Flow-Matching TTS achieves faster convergence and superior audio quality, outperforming traditional methods.
Existing Reinforcement Learning (RL) research for Text-to-Speech (TTS) focuses on large language models (LLMs), leaving Flow-Matching (FM) under-explored. We present FlowTTS-GRPO, an online RL framework for FM-based TTS. By converting ordinary differential equation (ODE) trajectories into stochastic differential equation (SDE) paths, our method enables direct fine-tuning of open-source FM models without auxiliary models. We show that a weighted reward combination converges faster than a probabilistic scheme, and identify three practical optimizations: omitting classifier-free guidance (CFG) during training accelerates convergence; synthesizing hard cases improves robustness; and applying RL to the FM component enhances audio-detail metrics. Experiments on CosyVoice 3.0 and F5-TTS demonstrate objective and subjective preference gains in speaker similarity and perceptual quality, with F5-TTS also improving intelligibility.
DAMO