Search papers, labs, and topics across Lattice.
This paper introduces a data aggregation and preprocessing pipeline for constructing high-quality ASR datasets from diverse open-source sources, specifically targeting low-resource languages. The pipeline emphasizes data diversity, balance, and the inclusion of word-level timestamps. Applied to Vietnamese, the pipeline yields a unified, 500-hour dataset that facilitates the training and evaluation of state-of-the-art ASR systems.
A new pipeline turns noisy, inconsistent open-source data into a 500-hour, high-quality Vietnamese ASR dataset, finally giving researchers a solid base for building better speech recognition.
Automatic Speech Recognition (ASR) performance is heavily dependent on the availability of large-scale, high-quality datasets. For low-resource languages, existing open-source ASR datasets often suffer from insufficient quality and inconsistent annotation, hindering the development of robust models. To address these challenges, we propose a novel and generalizable data aggregation and preprocessing pipeline designed to construct high-quality ASR datasets from diverse, potentially noisy, open-source sources. Our pipeline incorporates rigorous processing steps to ensure data diversity, balance, and the inclusion of crucial features like word-level timestamps. We demonstrate the effectiveness of our methodology by applying it to Vietnamese, resulting in a unified, high-quality 500-hour dataset that provides a foundation for training and evaluating state-of-the-art Vietnamese ASR systems. Our project page is available at https://github.com/qualcomm-ai-research/PhoASR.
