Search papers, labs, and topics across Lattice.
This paper investigates the phenomenon of skill contamination in self-evolving LLM agents, revealing that beyond a certain pool size, the introduction of new skills can degrade overall performance due to the inheritance of flawed reasoning. The authors formalize this contamination phase transition and propose a novel approach, Verifier-as-Gatekeeper (VaG), which employs a hierarchical filtering mechanism to assess skills based on structural validity, behavioral harmlessness, and semantic consistency before they are integrated. Experimental results demonstrate that VaG not only mitigates contamination but also enables performance improvements with a significantly smaller skill pool, highlighting the importance of pre-commitment in skill admission.
Skill contamination in LLM agents can lead to irreversible performance degradation, but a structured filtering approach can prevent this and enhance overall capabilities.
Self-evolving agents accumulate capability by distilling reusable skills from their execution trajectories, but we find this process is not monotonic: past a critical pool size, newly added skills degrade performance instead of improving it. We formalize this capability-contamination phase transition and trace it to a structural cause: once a defective skill enters the decision context, it becomes reference material for distilling later skills, forming cross-round contamination chains. We further show the contamination is structurally irreversible: removing a source skill after the fact cannot erase the flawed reasoning its descendants have already inherited, so post-hoc rollback recovers only a small fraction of the lost performance. This makes skill admission a pre-commit necessity rather than a post-hoc fix, and motivates Verifier-as-Gatekeeper (VaG): a progressive trust hierarchy whose three heterogeneous critics - structural validity, behavioral harmlessness, and semantic consistency - filter each skill individually, coupled with a marginal-gain subset selection that removes combinatorial contamination at the top tier before skills reach the runtime context. On Terminal-Bench 2, unconditional accumulation rises to a peak and then degrades, giving back most of its gains as the pool keeps growing, and post-hoc removal of the culprit skills recovers only a small part of the drop - the empirical signature of irreversibility. In contrast, VaG improves every round, reaching 72% pass@1 with a pool roughly 5x smaller, and its frozen skill pool transfers positively to four other backbones and a second benchmark without re-evolution. Ablations confirm the three critics are complementary and mutually non-substitutable, each intercepting a largely disjoint class of harmful skills.
