Search papers, labs, and topics across Lattice.
This paper introduces HiSME, a hierarchical skill meta-evolving framework that optimizes both skills and the skill evolving strategy for agentic systems. HiSME learns meta-skills from task execution traces, enabling lightweight algorithmic adaptation at test time. Experiments on diverse agentic benchmarks demonstrate that HiSME generates higher-quality skill libraries and derives diverse meta-skills compared to pure skill evolving, facilitating continual experience learning.
Forget hand-coded strategies: HiSME learns how to evolve skills on the fly, leading to better agent performance and continual learning.
Test-time skill evolving is regarded as a new paradigm for enhancing deployed agentic systems. Existing works mainly focus on hard-coded skill evolving strategies or parametric learning that rely on expensive parameter updates in the underlying LLMs. In this paper, we demonstrate that test-time refinement of the skill evolving framework itself is necessary for continuous improvement of the agent systems in different downstream scenarios, and lightweight algorithmic adaptation is feasible. Specifically, we propose HiSME, a lightweight hierarchical skill meta-evolving solution that jointly optimizes skills and the skill evolving strategy by learning meta-skills from agents' task execution traces. Experiments on diverse agentic benchmarks show that meta-evolving can produce a higher-quality skill library than pure skill evolving and can derive diverse meta-skills for different scenarios, thereby facilitating future continual experience learning. Our code is temporarily public at https://anonymous.4open.science/r/HiSME-BD45.
Tsinghua AI