Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces Lius, a fine-tuned large language model specifically designed for translating the low-resource language Kupang Malay through Continual Instruction Tuning (CIT). By utilizing explicit lexical and semantic features from a bilingual dictionary to create tailored instructions, Lius significantly outperforms standard instruction-tuned models and traditional Neural Machine Translation systems by 10-13 points across various metrics. These results underscore the effectiveness of CIT in enhancing translation capabilities for languages with limited data availability.
Lius achieves a remarkable 10-13 point improvement in translation accuracy for Kupang Malay, showcasing the power of tailored instruction and continual tuning in low-resource settings.
Large Language Models (LLMs) offer new potential for translation tasks but often experience performance degradation when handling low-resource languages. To address this limitation, we propose an approach for fine-tuning LLMs on a low-resource language, Kupang Malay. Our approach involves designing a set of instructions by leveraging explicit lexical and semantic features from a bilingual dictionary, and introducing Continual Instruction Tuning (CIT), a training paradigm that enables iterative instruction-based training. Experimental results demonstrate that our model, named Lius, yields notable improvements over standard instruction-tuned models by outperforming 4-6 points, and surpassing both Neural Machine Translation (NMT) and Multilingual LLM models by 10-13 points on several evaluation metrics. These findings highlight the potential of our approach to mitigate the reliance on large-scale parallel data in low-resource language translation.