Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces CraBERT, an innovative pre-trained phoneme encoder designed to enhance efficiency in text-to-speech (TTS) systems by integrating subword representations through a cascade-fusion architecture. By employing a subword-phoneme alignment algorithm, CraBERT leverages prior word and sentence-level information, significantly reducing the pre-training duration needed for effective phoneme encoding. The results indicate that CraBERT achieves comparable mean opinion score (MOS) values to existing phoneme encoders after just one epoch of pre-training, while traditional methods require around ten epochs, highlighting its efficiency and effectiveness in improving speech synthesis quality.
Achieving comparable speech synthesis quality with ten times less pre-training time could revolutionize TTS development.
This paper introduces CraBERT, a pre-trained phoneme encoder (PPEnc) designed for efficient pre-training in text-to-speech (TTS). CraBERT employs a cascade-fusion architecture and a subword-phoneme alignment algorithm to integrate representations from a pre-trained subword-level BERT into a phoneme-level BERT. This design provides prior word- and sentence-level information, reducing the amount of pre-training required by the phoneme encoder. Subjective listening evaluations show that CraBERT achieves MOS values comparable to existing PPEncs after approximately one epoch of pre-training, whereas the baselines in our comparison are pre-trained for approximately ten epochs. These results demonstrate that CraBERT can efficiently learn representations suitable for improving the perceived naturalness and prosody of synthesized speech.