Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This research conducts a systematic evaluation of various multilingual translation models for English-Tamil and Tamil-English translations, addressing the challenges posed by limited parallel data and domain variability. By analyzing models like NLLB and mBART across diverse datasets, the study reveals that dataset quality significantly impacts translation performance, while attention-based mechanisms enhance interpretability. Additionally, it highlights the effectiveness of in-context prompting with the TamilLaMA model for few-shot translation, demonstrating that large language models can achieve coherent translations despite the complexities of Tamil.
Dataset quality can dramatically influence translation outcomes, with attention mechanisms offering critical insights into model behavior.
The challenge of Machine Translation for low resource languages such as Tamil is primarily caused by the restricted amount of parallel data for these languages, as well as their substantial amount of domain variation and morphological complexity. This research presents the comprehensive evaluation of the performance of several multilingual translation models on English-Tamil and Tamil-English translations across multiple datasets: NTREX, EnTamV2, WikiMatrix and PMIndia. This study evaluates supervised NMT systems, NLLB and mBART, using both the BLEU and chrF metric, and examines how these systems perform on data of different quality levels and domains. This performs an attention-based analysis to increase model interpretability by visualising the alignments of tokens in an English source text and their Tamil translations and vice-versa to provide insight into how they make translations. This study also demonstrates that using in-context prompting can provide an excellent way to perform a few-shot translation of English to Tamil and Tamil-English using a Tamil capable TamilLaMA model, and compare this to supervised approaches qualitatively. These findings show that the quality of the datasets and their alignment with the domain will greatly affect the performance of the model, that attention-based mechanisms can aid in explain ability, and that few-shot large language models can still produce structurally coherent translations of Tamil.