Search papers, labs, and topics across Lattice.
This paper addresses the multifaceted security challenges posed by autonomous agents operating within complex environments, emphasizing that safety should be assessed at the level of overall behavior rather than individual actions. It highlights the vulnerabilities introduced by untrusted inputs, multi-agent interactions, and the need for behavioral containment to ensure compliance with operational constraints. The authors propose a unified principle that security must be an inherent verifiable property of the systems governing agent behavior, paving the way for more trustworthy deployments of autonomous agents.
Securing autonomous agents requires a paradigm shift from per-action checks to ensuring that their entire behavioral trajectory adheres to system-level safety constraints.
Autonomous agents are increasingly used to execute consequential tasks in environments governed by operational constraints, organizational policies, regulatory requirements, and technical standards. Their safety is therefore determined not by the correctness of individual actions, but by whether their overall behavior remains consistent with the rules and invariants of the systems in which they operate. As large language model (LLM)-based agents become more autonomous and increasingly delegate tasks across organizational boundaries, securing them evolves from a single challenge into a broad and interconnected landscape spanning the entire agentic stack. At the single-agent level, untrusted inputs through prompts, memory, retrieved knowledge, and tool interfaces create attack surfaces. In multi-agent settings, delegation and communication introduce challenges related to identity, trust, capability control, and decision transparency, while the underlying model routing and execution control plane remains vulnerable to manipulation and to unverified model provenance. Perhaps the most fundamental challenge is behavioral containment: sequences of individually permissible actions may collectively violate system-level constraints and safety invariants. At the broader level, supply-chain integrity, provenance, accountability, and end-to-end observability remain largely open problems. A common principle unifies these directions: security must become a verifiable property of the architectures, protocols, and runtimes that govern agent behavior, rather than an optional layer of guidance. Charting these challenges provides a roadmap toward trustworthy autonomous agent deployment.
