Search papers, labs, and topics across Lattice.
This paper introduces *TranslatePsy-AfriSLM*, a comprehensive collection of open-source machine translation resources tailored for 19 Sub-Saharan African languages, addressing the critical gap in high-quality parallel data. By employing unified quality-estimation filtering, the authors demonstrate that up to 96% of training tokens can be removed without compromising translation quality, leading to a significant efficiency gain. The fine-tuned small language models (SLMs) derived from this data outperform much larger models, showcasing the potential for competitive performance in low-resource settings.
Fine-tuned small language models can outperform massive counterparts by leveraging high-quality filtered data, challenging the notion that bigger is always better in machine translation.
The rapid progress in Artificial Intelligence has largely bypassed African languages, creating a digital divide that limits AI adoption on the continent. Recent open-source LLMs systematically underperform on African machine translation, while the lack of large-scale, high-quality, open-source parallel data has constrained the development of competitive small language models (SLMs). We introduce *TranslatePsy-AfriSLM*, a collection of open-source MT resources for 19 Sub-Saharan African languages, including curated parallel data, African-specialized synthetic data, and a family of fine-tuned SLMs. Our empirical study shows that unified quality-estimation filtering removes up to 96% of training tokens without degrading quality, and that filtered synthetic data dominates the quality-efficiency Pareto frontier. Fine-tuned on the resulting data mixture, TranslatePsy-AfriSLM outperforms substantially larger systems, including TranslateGemma-27B and Qwen3.5-122B-A10B, with as few as 0.8B parameters.
