Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces the Designed Vocalizations Dataset, which addresses the scarcity of resources for AI-based voice conversion focused on designed vocalizations, such as monster growls and robotic voices. By curating a diverse array of raw vocal sources and applying professional vocal effects processing, the authors create a comprehensive dataset that includes both human and animal voices. The dataset features a standardized test set with explicit splits for assessing generalization, along with baseline benchmark results to facilitate reproducible evaluation in future research.
Designed vocalizations are finally getting the attention they deserve, with a new dataset that bridges a critical gap in voice conversion research.
Advances in AI-based voice conversion have enabled a wide range of media applications, including films, audiobooks, and games. However, most research and public benchmarks still focus on natural human speech, leaving designed vocalizations, such as monster growls and robotic voices, underexplored, partly due to the lack of publicly available resources. To address this gap, we introduce the Designed Vocalizations Dataset, constructed by curating diverse raw vocal sources, including speech and animal vocalizations, and applying professional vocal effects processing to produce corresponding effect modified variants. We further provide a standardized test set with explicit seen/unseen splits over source timbre groups and preset styles to assess generalization under controlled conditions. Finally, we report baseline benchmark results to support reproducible evaluation and future research. The dataset and demo samples are available at https://ncai-official.github.io/speech/publications/designed-vocalizations-dataset/.