Search papers, labs, and topics across Lattice.
Miles v0.1 is an open-source, full-stack post-training system that decouples SGLang rollout engines from Megatron-LM and PyTorch FSDP training backends using topology-aware weight synchronization. The framework standardizes distributed execution across diverse post-training paradigms, including full-parameter and LoRA RL, true-on-policy rollout-training alignment, on-policy distillation, and diffusion models. In an end-to-end stress test, the system successfully executed fully asynchronous agentic RL on the GLM-5.2 744B-A40B MoE model across 64 NVIDIA GB300 GPUs, clocking a median step time of 263 seconds on terminal-use coding tasks.
Frontier-scale agentic RL on 700B+ MoEs is no longer locked inside hyperscaler proprietary stacks, achieving stable 263-second step times across 64 GB300 GPUs via a verified, open-source training infrastructure.
We present Miles v0.1, a full-stack, production-ready system for frontier post-training. Building upon the clean design of slime, Miles designs each stage of the reinforcement-learning (RL) training loop around a single principle: components should be verified, clean, and customizable. With accuracy, efficiency, reliability, and scalability as first-class goals, Miles aims to make frontier-scale RL accessible to researchers and enterprises alike. This report walks through the system end to end: rollout engines built on SGLang, a trainer with a choice of two backends (NVIDIA Megatron-LM and PyTorch FSDP), and three weight-synchronization transports for different deployment topologies. Beyond full-parameter RL, Miles also supports LoRA RL, on-policy distillation, supervised fine-tuning, and true-on-policy rollout-training alignment, and extends the same architecture to diffusion models. We close with an end-to-end case study: fully asynchronous agentic RL on a GLM-5.2 744B-A40B model over terminal-use coding tasks, running on 64 NVIDIA GB300 GPUs with a median step time of 263 seconds over the first 30 measured steps. Miles is open-sourced at https://github.com/radixark/miles, with the project website at https://miles.radixark.com.
