Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
RobustSpeechFlow improves TTS content fidelity by using length-preserving skip and repeat augmentations in contrastive flow matching. This approach directly penalizes common alignment failure modes without needing external aligners or preference data. Experiments on Seed-TTS-eval and ZERO500 show significant reductions in word and character error rates, demonstrating improved intelligibility across diverse conditions.
TTS models can be made more robust to alignment errors by directly penalizing skip and repeat failure modes during training, without needing external aligners.
While flow-matching text-to-speech (TTS) achieves strong zero-shot speaker similarity and naturalness, it remains susceptible to content fidelity issues, particularly skip and repeat errors from imperfect alignment. We propose RobustSpeechFlow, a training strategy that improves alignment robustness by extending contrastive flow matching with length-preserving repeat and skip latent augmentations. Requiring no external aligners or preference data, our method directly penalizes realistic failure modes and readily integrates into existing pipelines. On Seed-TTS-eval, it reduces the word error rate (WER) from 1.44 to 1.38 using only 0.06B parameters. On our ZERO500 benchmark, it delivers consistent intelligibility improvements across diverse speaker and prosody conditions; at NFE=24, it reduces English character error rate (CER) from 0.48\% to 0.35\% and Korean CER from 0.81\% to 0.57\%. Audio samples: https://robustspeechflow.github.io/