Search papers, labs, and topics across Lattice.
The paper introduces MSpoof-TTS, a training-free inference framework for neural codec language models that enhances zero-shot speech synthesis by using multi-resolution spoof detection to identify and prune unnatural token sequences. A multi-resolution token-based spoof detection framework is used to evaluate codec sequences at different temporal granularities, detecting inconsistent patterns. By integrating these spoof detectors into a hierarchical decoding strategy, the method progressively prunes low-quality candidates and re-ranks hypotheses, improving robustness and quality.
Achieve more robust and higher-quality speech synthesis from neural codec language models without any retraining, simply by pruning unnatural token sequences during inference.
Neural codec language models enable high-quality discrete speech synthesis, yet their inference remains vulnerable to token-level artifacts and distributional drift that degrade perceptual realism. Rather than relying on preference optimization or retraining, we propose MSpoof-TTS, a training-free inference framework that improves zero-shot synthesis through multi-resolution spoof guidance. We introduce a Multi-Resolution Token-based Spoof Detection framework that evaluates codec sequences at different temporal granularities to detect locally inconsistent or unnatural patterns. We then integrate the spoof detectors into a hierarchical decoding strategy, progressively pruning low-quality candidates and re-ranking hypotheses. This discriminator-guided generation enhances robustness without modifying model parameters. Experiments validate the effectiveness of our framework for robust and high-quality codec-based speech generation.
