Search papers, labs, and topics across Lattice.
CodePivot introduces a reinforcement learning framework that uses Python as an intermediate representation to train LLMs for multilingual code transpilation without parallel corpora. The method employs a novel "Aggressive-Partial-Functional" reward mechanism to guide the RL training process. Experiments across 10 programming languages demonstrate that a 7B parameter model trained with CodePivot outperforms much larger models (Deepseek-R1, Qwen3-235B) in both Python-to-Others and Others-to-All transpilation tasks, even for low-resource languages.
Forget parallel corpora: CodePivot shows you can train a 7B model to beat behemoth LLMs at multilingual code transpilation by pivoting through Python and using a clever RL reward.
Transpilation, or code translation, aims to convert source code from one programming language (PL) to another. It is beneficial for many downstream applications, from modernizing large legacy codebases to augmenting data for low-resource PLs. Recent large language model (LLM)-based approaches have demonstrated immense potential for code translation. Among these approaches, training-based methods are particularly important because LLMs currently do not effectively adapt to domain-specific settings that suffer from a lack of knowledge without targeted training. This limitation is evident in transpilation tasks involving low-resource PLs. However, existing training-based approaches rely on a pairwise transpilation paradigm, making it impractical to support a diverse range of PLs. This limitation is particularly prominent for low-resource PLs due to a scarcity of training data. Furthermore, these methods suffer from suboptimal reinforcement learning (RL) reward formulations. To address these limitations, we propose CodePivot, a training framework that leverages Python as an intermediate representation (IR), augmented by a novel RL reward mechanism, Aggressive-Partial-Functional reward, to bootstrap the model's multilingual transpilation ability without requiring parallel corpora. Experiments involving 10 PLs show that the resulting 7B model, trained on Python-to-Others tasks, consistently improves performance across both general and low-resource PL-related transpilation tasks. It outperforms substantially larger mainstream models with hundreds of billions more parameters, such as Deepseek-R1 and Qwen3-235B-A22B-Instruct-2507, on Python-to-Others tasks and Others-to-All tasks, respectively. In addition, it outperforms its counterpart trained directly on Any-to-Any tasks on general transpilation tasks. The code and data are available at https://github.com/lishangyu-hkust/CodePivot.
