Search papers, labs, and topics across Lattice.
SAGE is introduced as a closed-loop, multi-agent framework for self-evolving LLM reasoning, comprising Challenger, Planner, Solver, and Critic agents that co-evolve from a shared LLM backbone using a small seed set. The framework addresses limitations in self-play by incorporating explicit planning and quality control through the Critic, which filters generated questions and plans. Experiments on mathematics and code-generation benchmarks demonstrate that SAGE consistently improves performance across model scales, achieving significant gains on LiveCodeBench and OlympiadBench.
Forget RLHF and massive datasets: SAGE co-evolves reasoning abilities in LLMs using only a small seed set and a clever quartet of self-improving agents.
Reinforcement learning with verifiable rewards improves reasoning in large language models (LLMs), but many methods still rely on large human-labeled datasets. While self-play reduces this dependency, it often lacks explicit planning and strong quality control, limiting stability in long-horizon multi-step reasoning. We present SAGE (Self-evolving Agents for Generalized reasoning Evolution), a closed-loop framework where four agents: Challenger, Planner, Solver, and Critic, co-evolve from a shared LLM backbone using only a small seed set. The Challenger continuously generates increasingly difficult tasks; the Planner converts each task into a structured multi-step plan; and the Solver follows the plan to produce an answer, whose correctness is determined by external verifiers. The Critic scores and filters both generated questions and plans to prevent curriculum drift and maintain training signal quality, enabling stable self-training. Across mathematics and code-generation benchmarks, SAGE delivers consistent gains across model scales, improving the Qwen-2.5-7B model by 8.9% on LiveCodeBench and 10.7% on OlympiadBench.
