Search papers, labs, and topics across Lattice.
OPD-Evolver introduces a novel slow-fast co-evolution framework that enhances the capabilities of self-evolving agents through on-policy self-distillation. By leveraging a four-level memory hierarchy, the system effectively manages experience to support rapid evolution during test-time, while also distilling high-value experiences into a deployable policy. The results demonstrate that OPD-Evolver outperforms existing memory systems and training-based methods across multiple benchmarks, highlighting its potential to create more competent agent evolvers.
OPD-Evolver outperforms traditional memory systems by up to 11.5%, showcasing a new paradigm in agent evolution that transcends mere memory storage.
Memory has become a standard substrate for self-evolving agents, yet retaining experience is not the same as learning how to evolve through it. Existing memory agents can store trajectories, retrieve reflections, or accumulate skills, but often lack the holistic competence to select useful experience, act on it, write reusable knowledge, and maintain a growing repository. We introduce OPD-Evolver, a slow-fast co-evolution framework that cultivates such an agent evolver through on-policy self-distillation. In the fast loop, OPD-Evolver interacts with a four-level memory hierarchy to read, use, write, and maintain experience for rapid test-time evolution. In the slow loop, outcome-calibrated memory attribution and privileged hindsight distill these four abilities into the deployable policy. Across multi-domain benchmarks, OPD-Evolver surpasses memory systems such as ReasoningBank by up to 11.5%, and training-based methods such as Skill0 by ~5.8%. Further analysis shows that OPD-Evolver internalizes high-value experience and memory management, enabling OPD-Evolver-9B to challenge giant counterparts such as Qwen3.5-397B-A17B and Step-3.5-Flash, pointing beyond memory-augmented agents toward genuinely qualified agent evolvers.
NUS