Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces OscillaTTS, a novel diffusion-based text-to-speech (TTS) system that incorporates an adaptive oscillatory nonlinearity to better model sharp prosodic transitions and rapid pitch variations. By integrating a linear bypass component, the system maintains signal stability while allowing for controllable periodic modulation, addressing the limitations of existing nonlinearities like the Snake activation function. Experimental results on the LJSpeech and Emotional Speech Dataset demonstrate significant improvements in both objective and subjective evaluations of expressive speech quality.
OscillaTTS achieves a breakthrough in modeling expressive speech dynamics, outperforming traditional methods in capturing rapid prosodic changes.
Diffusion-based text-to-speech (TTS) models have achieved significant improvements in speech quality. However, modeling sharp prosodic transitions and rapid pitch variations in expressive speech remains challenging. Existing diffusion-based TTS decoders commonly utilize periodic nonlinearities such as Snake activation function to capture harmonic structures, but this activation funcation provides limited adaptability when modeling abrupt amplitude and frequency variations. In this paper, we investigate the role of oscillatory inductive bias in diffusion-based TTS decoders and introduce an adaptive oscillatory nonlinearity that enables controllable periodic modulation while maintaining signal stability through a linear bypass component. We refer the resulting TTS system as OscillaTTS. Experiments on the LJSpeech and Emotional Speech Dataset show consistent improvements across objective and subjective evaluations, indicating improved modeling of expressive prosodic dynamics.