Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a language-agnostic alignment mechanism for ASR hypotheses and reference transcriptions, particularly addressing the challenges posed by non-Latin scripts. The method enables consistent alignment across diverse writing systems (Abugida, Alphabetic, and Abjad) and ASR architectures, facilitating downstream linguistic analysis like PoS-wise error characterization. Experiments demonstrate the effectiveness of the alignment and subsequent error analysis in improving WER during ASR training across multiple languages.
Finally, a reliable, automated alignment tool unlocks fine-grained ASR error analysis for non-Latin script languages, paving the way for targeted improvements in ASR performance.
Automatic Speech Recognition (ASR) systems are commonly evaluated using aggregate metrics such as Word Error Rate (WER), which do not capture the linguistic structure of errors. Fine-grained analysis, such as Part-of-Speech (PoS)-wise error characterization, requires accurate alignment between ASR hypotheses and reference transcriptions. However, existing alignment tools are often unreliable for languages written in non-Latin scripts. In this work, we address this gap by proposing a robust, automated, language-agnostic alignment mechanism applicable across ASR architectures and across languages written in both Latin and non-Latin scripts. This enables consistent alignment of hypotheses, references, and evaluation sequences, forming the basis for downstream linguistic analysis. Building on this, we employ standard PoS taggers to perform scalable and reproducible PoS-wise error analysis. Notably, we perform alignment and downstream ASR error analysis across three major segmented writing systems, namely, Abugida (Tamil, Hindi, Kannada), Alphabetic (English, Russian, Greek), and Abjad (Arabic). We further demonstrate how such error information can be leveraged during ASR training to improve metrics such as WER.