Search papers, labs, and topics across Lattice.
This study explores the effectiveness of cross-lingual transfer learning from Sinhala to improve automatic speech recognition (ASR) for Dhivehi, a low-resource language. Through seventeen experiments across five paradigms, the researchers found that continual pre-training on Sinhala followed by fine-tuning on Dhivehi yielded a significant reduction in word error rate (WER) and character error rate (CER), outperforming the Dhivehi-only baseline. The results highlight the importance of both the adaptation strategy and decoding configuration in achieving successful transfer learning outcomes.
Continual pre-training on a related language can dramatically enhance ASR performance in low-resource languages like Dhivehi, achieving a 13.50% reduction in WER.
Dhivehi, the national language of the Maldives, is currently under-resourced for automatic speech recognition (ASR) and other NLP tasks. This study investigates whether cross-lingual transfer learning from Sinhala, a linguistically related, relatively well-resourced Insular Indo-Aryan language, can improve Dhivehi ASR. We conduct seventeen experiments across five transfer learning paradigms: Dhivehi-only baselines, sequential fine-tuning, multilingual fine-tuning, continual pre-training, and a control using Turkish as an unrelated language. The strongest system, continual pre-training on Sinhala followed by fine-tuning on Dhivehi with KenLM, achieves 12.89% WER and 2.70% CER, outperforming the Dhivehi-only baseline by 13.50% WER and 3.02% CER. However, the adaptation strategy and decoding configuration are equally critical for a successful transfer learning experiment. We conduct seventeen controlled experiments spanning five transfer learning paradigms: Dhivehi-only baselines, sequential fine-tuning, multilingual fine-tuning, continual pre-training, and a control experiment using Turkish as an unrelated language. The strongest system, continual pre-training on Sinhala followed by fine-tuning on Dhivehi with KenLM, achieves 12.89% WER and 2.70% CER, outperforming the Dhivehi-only baseline by 13.50% WER and 3.02% CER. The Turkish control experiment confirms that observed improvements stem from linguistic relatedness; adaptation strategy and decoding configuration are also critical.
