Search papers, labs, and topics across Lattice.
This paper introduces SkillEvo, a novel framework that enhances the evolution of agent skills through multi-turn interaction feedback, addressing the limitations of existing methods that rely on single-turn evaluations. By implementing a feedback generator that utilizes follow-up questions to uncover and rectify defects iteratively, SkillEvo maintains a continuous evolution gradient that prevents degradation over time. The results demonstrate a significant improvement in skill performance, with SkillEvo outperforming traditional methods by 23.0 points and 15.4 points in various evaluations across multiple cloud service categories.
SkillEvo achieves a 23-point boost in skill evolution by transforming multi-turn interactions into a continuous feedback loop that actively repairs defects.
Agent Skills are today either hand-authored or produced in a single LLM generation pass, and consequently possess no closed loop through which they might improve from the interaction failures they actually cause. Recent work does close this loop, but derives its feedback from single-turn question-answering evaluation. The consequence is a sharp asymmetry: once the first round has patched the gaps that a single exchange can reveal, the evolution gradient decays, the defects that surface only across multiple turns remain invisible, and evolution stalls. Governance in these systems is likewise driven by an end-to-end verification score, a scalar gate that can reject a degraded candidate but can neither localize nor repair its structural cause. We argue that the binding constraint on sustained skill evolution is neither editing capability nor the number of iterations, but whether the evaluation feedback keeps supplying trustworthy evolution gradients. We introduce SkillEvo, in which trustworthy feedback generates the gradient and controllable governance constrains its direction. The first component recasts multi-turn user simulation from an evaluation endpoint into a feedback generator: follow-up questions expose defects layer by layer, so that every round of revision both consumes feedback and produces new feedback. The second replaces the passive rejection of a scalar gate with an independent governance layer that actively repairs factual degradation and structural bloat, preventing the gradient from drifting as degradation accumulates. Across six categories of cloud services, 9 production Skills, and 98 skill-reference files, SkillEvo surpasses self-reflection-based evolution by 23.0 points and single- turn-QA-driven evolution by 15.4 points.
