Search papers, labs, and topics across Lattice.
This paper details the development of an open-source automatic speech recognition (ASR) system specifically designed for assessing children's reading in Bambara, a language with limited existing resources. The authors collected 55 hours of reading data from 60 children, leading to the creation of a public benchmark and demonstrating that their Bambara-adapted Fast-Conformer ASR model, Soloni, significantly outperforms the compact QuartzNet architecture in terms of word error rate (WER) and character error rate (CER). Key findings indicate that while repeated readings improve performance for QuartzNet, they yield marginal gains for Soloni, highlighting the need for targeted data collection from younger readers to address residual errors.
Soloni, a Bambara-adapted ASR model, achieves a remarkable reduction in word error rate from 0.42 to 0.22, outperforming existing architectures and paving the way for effective literacy assessments in underrepresented languages.
Automatic speech recognition for children's reading remains underdeveloped for most African languages, including Bambara, despite its potential value for reproducible literacy assessment. We present an open-source system for assessing children's reading in Bambara, developed through an end-to-end process linking field data collection, benchmark construction, model adaptation, a reading application, and classroom validation. A mobile collection and assessment app was used to collect 55 hours of raw reading speech from 60 children, from which we construct a public benchmark for Bambara child-reading assessment. Fine-tuning experiments compare Soloni, a Bambara-adapted Fast-Conformer ASR framework with TDT and CTC decoders, with QuartzNet, a compact convolutional ASR architecture. The best Soloni model reduces WER from 0.42 to 0.22 and CER from 0.15 to 0.08, substantially outperforming QuartzNet on the isolated benchmark. The experiments further show that repeated readings of the same texts provide architecture-dependent benefits: they substantially improve QuartzNet but add only marginal gains for Soloni, while SpecAugment regulates training without exceeding the best unaugmented configuration. Disaggregated analysis identifies children under 10 as the main source of residual errors, motivating targeted collection from younger readers. Ten classroom trials supported continued use of the application.