Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper presents a methodology for LLM-assisted continuous code translation, migrating a large production Rust codebase (Codex CLI) to Python using public agent benchmarks as the objective function for iterative refinement. The resulting Python port achieves near-parity performance on real-world agentic tasks (SWE-bench Verified and Terminal-Bench) compared to the original Rust implementation and facilitates more effective debugging. Furthermore, the Python port evolves into a capability superset with new features while maintaining a strict parity mode for comparison.
LLM-assisted code translation, driven by agent benchmarks, not only achieves near-parity performance when migrating a large Rust codebase to Python, but also unlocks a capability superset with a 15.9x code reduction.
Cross-language migration of large software systems is a persistent engineering challenge, particularly when the source codebase evolves rapidly. We present a methodology for LLM-assisted continuous code translation in which a large language model translates a production Rust codebase (648K LOC, 65 crates) into Python (41K LOC, 28 modules), with public agent benchmarks as the objective function driving iterative refinement. Our subject system is Codex CLI, a production AI coding agent. We demonstrate that: (1) the Python port resolves 59/80 SWE-bench Verified tasks (73.8%) versus Rust's 56/80 (70.0%), and achieves 42.5% on Terminal-Bench versus Rust's 47.5%, confirming near-parity on real-world agentic tasks; (2) benchmark-driven debugging, revealing API protocol mismatches, environment pollution, a silent WebSocket failure mode, and an API 400 crash, is more effective than static testing alone; (3) the architecture supports continuous upstream synchronisation via an LLM-assisted diff-translate-test loop; and (4) the Python port has evolved into a capability superset with 30 feature-flagged extensions (multi-agent orchestration, semantic memory, guardian safety, cost tracking) absent from Rust, while preserving strict parity mode for comparison. Our evaluation shows that for LLM-based agents where API latency dominates, Python's expressiveness yields a 15.9x code reduction with negligible performance cost, while the benchmark-as-objective-function methodology provides a principled framework for growing a cross-language port from parity into an extended platform.