Track synthesis, materials and catalysis as it is published.
Search papers, labs, and topics across Lattice.
This paper introduces EvoSkill Injection, a novel threat model that targets the autonomous skill generation and evolution processes in self-evolving agents, which are increasingly utilized in LLM-based systems. The authors propose SARGE, a red-teaming framework designed to evaluate this threat through iterative interactions, and develop two benchmark datasets, EvoSkillBench and EvoSkillSafetyBench, to assess the impact of malicious skill formation. The findings reveal that SARGE effectively induces malicious skills that are not only stored but also persistently activated, underscoring the significant risk of capability corruption in autonomous agents.
Malicious skills can be persistently stored and activated in self-evolving agents, posing a serious threat to their operational integrity.
LLM-based agent systems increasingly adopt skill-based architectures to reduce repetitive reasoning costs and improve stable, efficient task execution. Recent studies propose self-evolving agents that autonomously generate, refine, and reuse skills from past experiences to enable continuous capability evolution. However, autonomous skill evolution introduces a new attack surface in which malicious capabilities are generated, stored, and reused as legitimate skills. In this paper, we define EvoSkill Injection as a threat model targeting the autonomous skill generation and evolution pipeline of self-evolving agents. We further propose SARGE (Red-teaming Autonomous Skill Generation and Evolution in self-evolving agents), a red-teaming framework for evaluating this threat model through iterative generation, escalation, and reinforcement interactions. To support our framework, we construct EvoSkillBench, a benchmark dataset of malicious interaction trajectories for inducing malicious skill formation in self-evolving agents, and introduce EvoSkillSafetyBench, a post-attack benchmark for evaluating whether injected malicious skills are subsequently retrieved and activated as harmful behaviors. Our evaluation shows that SARGE induces malicious skill formation and that injected skills are persistently stored and repeatedly activated, highlighting the risk of persistent capability corruption.