Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
MiMo-V2.6 scales reinforcement learning compute to 1M context length with asynchronous training, diverse environments, and groupwise agentic grading to improve omni-modal foundation models. This approach addresses challenges in long-horizon tasks and reward hacking by freezing MoE routers and implementing multi-layer defenses. The resulting MiMo-V2.6 series pushes the frontier of model intelligence through extensive RL training.
Omni-modal foundation models achieve self-improvement via RL compute scaled to 1M context, leveraging asynchronous training and agentic grading for enhanced intelligence.
Reinforcement learning (RL) is the central training paradigm for advancing large foundation models towards self-improvement. This report introduces the MiMo-V2.6 series, an omni-modal family that pushes the frontier of model intelligence by scaling RL compute. Prior to RL, we conduct mid-training on a broad multimodal corpus to provide ample exploration space, and build a solid infrastructure on the pretrained hybrid-SWA architecture to support subsequent scale-up. We scale RL compute along three dimensions: (1) larger batches and higher throughput, with an asynchronous training that consumes 1,568 samples and 2.7-3.7B tokens per step at context lengths of up to 1M; (2) more diverse and complex environments, spanning code, general, visual, and cyber domains under a mixture of agent harnesses; and (3) more grader compute, via groupwise agentic grading that yields more accurate reward signals for long-horizon tasks and steers the model towards shorter, more token-efficient solutions. To keep training stable at scale, we freeze the MoE router and establish a multi-layer defense against reward hacking. We further build infrastructure for mixed-task agentic RL, including a unified trajectory representation, high-concurrency multi-framework rollout, decoupled control and data planes, and training-inference consistency. We open-source the training dynamics, RL environments, and RL framework to facilitate reproduction and further research on scaled RL and model self-improvement.