Search papers, labs, and topics across Lattice.
This paper introduces Self-Routing, a behavior-conditioned post-training framework for large language models that optimizes sample-level learning based on the model's own rollout performance. By dynamically routing samples to different optimization strategies鈥攕uch as GRPO, on-policy self-distillation, or regularization鈥擲elf-Routing enhances training efficiency without the need for external teachers or additional annotations. Experimental results demonstrate that this approach significantly outperforms traditional uniform training methods and adapts the routing distribution throughout training to minimize unnecessary updates on stable samples.
Self-Routing adapts optimization strategies on-the-fly, leading to significant improvements in mathematical reasoning tasks without relying on external supervision.
Post-training large language models usually applies a single training recipe to all samples, even though the model's own rollouts reveal different sample-level learning states. We propose Self-Routing, a behavior-conditioned post-training framework that uses rollout correctness and confidence to decide how each sample should be optimized. Depending on its behavior state, a sample is routed to GRPO, on-policy self-distillation, regularization, or skipping, allowing training to adapt without external teachers, extra annotations, or additional sampling. Experiments on mathematical reasoning across Qwen3 and Qwen3.5 backbones show that Self-Routing consistently improves over uniform GRPO, uniform OPSD, fixed mixtures, and simpler routing baselines. Further analyses show that the routing distribution changes over training and reduces unnecessary updates on low-signal or already stable samples.
