Search papers, labs, and topics across Lattice.
This paper surveys the evolving landscape of agent skill evaluation and evolution, emphasizing the shift from isolated skill creation to an automated, evaluation-driven approach. It categorizes skill evolution into four paradigms鈥攅xecution feedback, trajectory distillation, compression, and reinforcement learning鈥攈ighlighting their contributions to enhancing skill utility and reliability. Additionally, the authors analyze six benchmark categories, revealing structural gaps and proposing directions for developing generalizable and safe skill ecosystems.
Automated evaluation-driven skill evolution could redefine how we build and assess agentic systems, making them more reliable and efficient.
The growth of agent skills has transformed how agentic systems are built, evaluated, and deployed. As skill libraries continue to scale, rigorous evaluation becomes critical to ensuring their utility, quality, and safety in real-world applications. Consequently, the field is undergoing an emerging paradigm shift from isolated skill creation to automated, evaluation-driven skill evolution. In this survey, we systematically examine the landscape of skill evolution and evaluation beyond foundational skill creation. We categorize evolution into four distinct paradigms, spanning execution feedback, trajectory distillation, compression, and reinforcement learning, showing how each element contributes to improving skill utility and reliability. We also provide an analysis of six skill-centric benchmark categories, identifying structural gaps in benchmark coverage, trade-offs, and metric richness to advance skill research. Finally, we identify open directions for building skill ecosystems that are generalizable, efficient, and verifiably safe. The project URL is https://github.com/Cassie07/AgentSkill_Survey
