Search papers, labs, and topics across Lattice.
This paper introduces Indic DiarBench, a comprehensive benchmark dataset for speaker diarization and automatic speech recognition (ASR) across all 22 scheduled languages of India, featuring 108 hours of diverse audio recordings. The dataset is meticulously annotated with human-corrected, time-aligned transcriptions that reflect the unique conversational characteristics of Indian speech, including code-mixing and dialectal variations. Evaluations of leading ASR systems and multimodal large language models on this benchmark reveal significant insights into their performance in multilingual contexts, establishing a crucial baseline for future research in inclusive speech technology.
Indic DiarBench reveals that existing ASR systems struggle with the rich linguistic diversity of Indian languages, highlighting a critical gap in multilingual speech technology.
In this work, we introduce Indic DiarBench, a speaker diarization and ASR benchmark dataset spanning all 22 scheduled languages of India. This corpus comprises approximately 108 hours of natural multi-speaker audio from near-field meetings, far-field recordings, and in-the-wild audios. All annotations are human-corrected with time-aligned speaker attributed transcriptions. The dataset captures conversational nuance prevalent in Indian speech, such as English code-mixing, dialectal variation, and frequent speaker overlap. To establish a baseline for joint ASR and diarization capabilities we evaluate leading systems including commercial speech APIs and multimodal large language models. Indic DiarBench is released as an open-access resource to advance inclusive, multilingual speech technology research for Indian languages.
