Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study evaluates the performance of foundational automatic speech recognition (ASR) models on narrow-band telephony conversations in Hindi and Indian-accented English, revealing suboptimal results in a zero-shot setting. The research highlights the challenges faced by ASR systems in low-resource languages and accents, emphasizing the limitations of existing models. Fine-tuning open-source ASR models with limited annotated data yields some improvements, but the effectiveness is inconsistent and heavily dependent on pretraining data diversity.
Fine-tuning ASR models on low-resource languages shows promise, but improvements are inconsistent and tied to pretraining data quality.
Telephony conversations worldwide are conducted over narrow-band channels and are often spontaneous and colloquial in nature. This paper evaluates the performance of widely used foundational automatic speech recognition (ASR) models -- both open-source and commercial -- on narrow-band conversations in Hindi, a low-resource language, and Indian-accented English, a low-resource accent. We first assess these models in a zero-shot setting and find that their performance remains suboptimal across the board. Highlighting the challenges faced by ASR models in narrow-band and low-resource language scenarios, we further investigate the impact of fine-tuning open-source models using a limited set of real-life annotated recordings. Our findings indicate that while fine-tuning provides some improvements, its effectiveness varies across languages and accents, largely influenced by the amount of data encountered during pretraining