Search papers, labs, and topics across Lattice.
This paper analyzes the growth and characteristics of the Pashto Common Voice dataset, a crucial resource for developing ASR systems for this underrepresented language. The study tracks the dataset's expansion from 1.49 hours in 2023 to 2,768.7 hours in 2025, with 975.89 validated hours suitable for ASR training. The analysis reveals concentrated contributor participation, skewed age representation, incomplete demographic metadata, and moderate prompt reuse, highlighting areas for improvement in dataset maturity and inclusivity.
Despite rapid growth, the Pashto Common Voice dataset suffers from concentrated participation and skewed demographics, limiting its utility for fair and representative ASR systems.
Large, openly licensed speech datasets are essential for building automatic speech recognition (ASR) systems, yet many widely spoken languages remain underrepresented in public resources. Pashto, spoken by more than 60 million people, has historically lacked large-scale openly licensed speech data suitable for modern ASR development. This paper presents a release-level analysis of the Pashto component of the Mozilla Common Voice corpus, focusing on version 24.0 (December 2025) and contextualizing trends across major releases. We document rapid growth from 1.49 recorded hours in mid-2023 to 2,768.7 total hours in 2025, including 975.89 validated hours available for supervised ASR training. Beyond scale, we analyze validation throughput, contributor participation inequality, demographic metadata completeness, and sentence-level concentration in the validated subset. We find that participation is extremely concentrated (Gini = 0.941), age representation is strongly skewed toward young adults, and 41.97\% of clips lack self-reported gender labels, limiting subgroup auditing based on metadata. At the textual level, prompt reuse is moderate: 35.88\% of unique sentences account for 50\% of validated clips, suggesting that structural concentration is driven primarily by uneven contributor activity rather than dominance of a small prompt set. These results provide a quantitative audit of a rapidly scaling low-resource speech corpus and highlight practical priorities for improving dataset maturity, including expanded validation capacity and broader demographic participation.
