Search papers, labs, and topics across Lattice.
This paper introduces AgentFlow, a novel flow-centric policy language and enforcement framework designed to secure LLM agent systems by controlling the flow of sensitive data across various actions. The framework allows for the specification of policies that dictate which tools can access sensitive information and how data can be delegated, significantly mitigating risks associated with unsafe data flows. Evaluations demonstrate that AgentFlow effectively reduces confirmed compromises to zero across multiple benchmarks while maintaining or improving overall utility metrics, showcasing its potential to enhance the safety of LLM agents in practical applications.
AgentFlow eliminates data compromise in LLM agents, achieving a remarkable reduction from 33% to 0% in confirmed unsafe actions while boosting utility.
LLM agents increasingly read untrusted content, invoke external tools, access private data, and delegate work to other agents. Harm often arises not from a single unsafe action but from the flow of sensitive data across a sequence of otherwise plausible steps. We present AgentFlow, a flow-centric policy language and runtime enforcement model for specifying where data may travel in agent systems. Policies are defined over labeled runtime edges and constrain which tools may receive sensitive fields, which sinks may receive released data, and what authority may cross delegation boundaries. The language supports flow and path rules, task-scoped capabilities, controlled release, and stateful taint semantics. A runtime reference monitor mediates agent actions, and a bounded SMT-based verifier checks safety properties for a structured policy fragment. We evaluate AgentFlow on multiple agent benchmarks. In our prototype, seven safety properties verify in under 0.5 seconds each, and the verifier catches all seeded unsafe policy variants in our study. On 949 AgentDojo injected cases across four suites, AgentFlow reduces confirmed compromise from 33.0\% to 0.0\% while improving aggregate utility from 46.7\% to 63.3\%. On a 200-case AgentDyn Dailylife benchmark, it reduces confirmed compromise from 73.5\% to 0.0\% while preserving near-baseline utility (44.5\% to 43.5\%). Breadth checks across ASB, InjecAgent, BIPIA, AgentHarm, and MCPTox replays suggest that the configured policies block the benchmark-specified policy-visible attacker flows; in ASB's direct-prompt-injection harness, attack success is 0/1{,}200. These results are preliminary and scoped to the modeled policy-visible agent behaviors and evaluated benchmarks.
