Search papers, labs, and topics across Lattice.
The paper introduces LANG, a reinforcement learning framework designed to improve multilingual reasoning in LLMs by using language-conditioned hints to guide exploration. LANG addresses the trade-off between input-language consistency and reasoning quality by employing a progressive decay schedule for hint withdrawal and a language-adaptive switch to adjust learning horizons. Experiments on multilingual math benchmarks demonstrate that LANG significantly boosts reasoning performance while maintaining language consistency, and generalizes to improve language alignment in other tasks.
Stop LLMs from drifting to English when reasoning in other languages: language-adaptive RL can guide them to stay consistent without sacrificing performance.
Reinforcement learning has proven effective for enhancing multi-step reasoning in large language models (LLMs), yet its benefits have not fully translated to multilingual contexts. Existing methods struggle with a fundamental trade-off: prioritizing input-language consistency severely hampers reasoning quality, while prioritizing reasoning often leads to unintended language drift toward English. We address this challenge with LANG, a novel framework that leverages language-conditioned hints to guide exploration in non-English reasoning tasks. Our method incorporates two key mechanisms to prevent dependency on these hints: a progressive decay schedule that gradually withdraws scaffolding, and a language-adaptive switch that tailors learning horizons to specific language difficulties. Empirical results on challenging multilingual mathematical benchmarks reveal that LANG substantially enhances reasoning performance without compromising language consistency. Moreover, we show that our framework generalizes beyond mathematics, fostering more consistent language alignment across model layers
