Search papers, labs, and topics across Lattice.
This paper investigates the ability of LLMs to perform Swiss German dialect classification using ASR-generated phonetic transcriptions, comparing their performance to HuBERT and human linguists. The approach augments transcriptions with linguistic resources like dialect feature maps and vowel histories to guide LLM predictions. Results show that LLMs can improve dialect classification accuracy when provided with structured linguistic information, though human linguists still outperform them, even with imperfect ASR transcriptions.
LLMs can classify dialects with surprising accuracy when given linguistic hints, suggesting a new way to leverage their knowledge for low-resource language tasks.
Due to the scarcity of labeled dialectal speech, audio dialect classification is a challenging task for most languages, including Swiss German. In this work, we explore the ability of large language models (LLMs) as agents in understanding the dialects and whether they can show comparable performance to models such as HuBERT in dialect classification. In addition, we provide an LLM baseline and a human linguist one. Our approach uses phonetic transcriptions produced by ASR systems and combines them with linguistic resources such as dialect feature maps, vowel history, and rules. Our findings indicate that, when linguistic information is provided, the LLM predictions improve. The human baseline shows that automatically generated transcriptions can be beneficial for such classifications, but also presents opportunities for improvement.
