Search papers, labs, and topics across Lattice.
This paper introduces SkillSec-Eval, a comprehensive framework for evaluating the security of reusable skills in Large Language Model (LLM) agents, addressing a significant gap in existing security research that has primarily focused on prompt injection and runtime execution. By characterizing the skill lifecycle and developing a detailed threat taxonomy, the authors identify vulnerabilities across various stages, including repository admission and skill evolution. The empirical evaluation of 327 real-world skills reveals that security risks are prevalent at multiple lifecycle stages, underscoring the necessity for a lifecycle-aware approach to skill security.
Vulnerabilities in reusable agent skills can emerge at every stage of their lifecycle, not just during execution, revealing a critical oversight in current security practices.
Reusable skills are becoming a fundamental building block of Large Language Model (LLM) agents, enabling capabilities to be packaged, shared, and reused across diverse applications. However, existing security research primarily focuses on prompt injection and runtime execution, leaving security risks throughout the broader skill lifecycle largely unexplored. In this paper, we present SkillSec-Eval, a lifecycle-aware framework for systematically evaluating the security of reusable agent skills. We first characterize the skill lifecycle and develop a threat taxonomy spanning repository admission, semantic retrieval, planner selection, execution, and skill evolution. We then instantiate this taxonomy in SkillSec-Eval and conduct a comprehensive empirical evaluation using a repository of 327 real-world skills. Our study demonstrates that vulnerabilities arise at multiple lifecycle stages beyond execution, highlighting the need for lifecycle-aware security analysis of reusable agent skills.
