Search papers, labs, and topics across Lattice.
MOSS-VoiceGenerator, an open-source instruction-driven voice generation model, was developed to create realistic speaker timbres directly from natural language prompts. The model is trained on large-scale expressive speech data sourced from cinematic content to capture real-world acoustic variation. Subjective evaluations demonstrate that MOSS-VoiceGenerator outperforms existing voice design models in overall performance, instruction-following, and naturalness.
Cinematic speech data unlocks more realistic and controllable voice generation from natural language descriptions.
Voice design from natural language aims to generate speaker timbres directly from free-form textual descriptions, allowing users to create voices tailored to specific roles, personalities, and emotions. Such controllable voice creation benefits a wide range of downstream applications-including storytelling, game dubbing, role-play agents, and conversational assistants, making it a significant task for modern Text-to-Speech models. However, existing models are largely trained on carefully recorded studio data, which produces speech that is clean and well-articulated, yet lacks the lived-in qualities of real human voices. To address these limitations, we present MOSS-VoiceGenerator, an open-source instruction-driven voice generation model that creates new timbres directly from natural language prompts. Motivated by the hypothesis that exposure to real-world acoustic variation produces more perceptually natural voices, we train on large-scale expressive speech data sourced from cinematic content. Subjective preference studies demonstrate its superiority in overall performance, instruction-following, and naturalness compared to other voice design models.
