Search papers, labs, and topics across Lattice.
This study explores reference-free post-training techniques for multilingual machine translation using open large language models, specifically enhancing the MiLMMT-46-v0.1 models through Group Relative Policy Optimization (GRPO). By employing a reward mechanism that integrates two reference-free quality estimation models and adjusting for language identification, the authors achieve significant improvements in translation quality across 46 languages. The resulting MiLMMT-46-v1.0 models not only outperform strong open baselines but also achieve leading reference-free scores against proprietary systems like Google Translate and GPT-5.
Achieving superior translation quality without relying on reference data, this approach sets a new benchmark in multilingual machine translation.
We study reference-free post-training for multilingual machine translation with open large language models. Starting from the supervised-finetuned MiLMMT-46-v0.1 models, we apply Group Relative Policy Optimization (GRPO) with a reward that averages two reference-free quality estimation models and is gated by language identification. We then linearly interpolate the supervised fine-tuning (SFT) and reinforcement learning (RL) model checkpoints to obtain MiLMMT-46-v1.0. Across 46 languages, the resulting models consistently improve translation quality over their SFT counterparts, outperform strong recent open baselines, including Seed-X, HY-MT2, and TranslateGemma, and achieve leading reference-free scores against evaluated proprietary systems such as Google Translate, Gemini 3 Pro, and GPT-5. We further investigate on-policy distillation (OPD) and find that it reaches, but does not surpass, the quality frontier achieved by RL with checkpoint interpolation. We release the models and code to facilitate future research.
