Search papers, labs, and topics across Lattice.
This paper introduces a framework for robust Bangla ASR and speaker diarization tailored for long-form audio, addressing the challenges posed by the language's low-resource status in NLP. The framework optimizes Voice Activity Detection (VAD) and employs Connectionist Temporal Classification (CTC) segmentation through forced word alignment to improve temporal accuracy in long audio segments. Results demonstrate improved performance in complex, multi-speaker Bangla speech scenarios, offering a scalable solution for real-world applications.
Overcome the limitations of existing Bangla ASR systems on long-form audio with a framework that leverages VAD optimization and CTC alignment for improved accuracy and scalability.
Despite being one of the most widely spoken languages globally, Bangla remains a low-resource language in the field of Natural Language Processing (NLP). Mainstream Automatic Speech Recognition (ASR) and Speaker Diarization systems for Bangla struggles when processing longform audio exceeding 3060 seconds. This paper presents a robust framework specifically engineered for extended Bangla content by leveraging preexisting models enhanced with novel optimization pipelines for the DL Sprint 4.0 contest. Our approach utilizes Voice Activity Detection (VAD) optimization and Connectionist Temporal Classification (CTC) segmentation via forced word alignment to maintain temporal accuracy and transcription integrity over long durations. Additionally, we employed several finetuning techniques and preprocessed the data using augmentation techniques and noise removal. By bridging the performance gap in complex, multi-speaker environments, this work provides a scalable solution for real-world, longform Bangla speech applications.
