Track the frontier, from condensed matter to cosmology.
Search papers, labs, and topics across Lattice.
The paper introduces Data Over-Exposure (DOE), a privacy risk in LLM agents where sensitive data is inadvertently transmitted beyond user intent. To address this, they present AgentRaft, an automated framework that combines cross-tool function call graph construction, targeted prompt synthesis, and multi-LLM voting based on privacy regulations for DOE detection. Experiments on 6,675 real-world agent tools reveal that DOE is prevalent, affecting 57.07% of tool interaction paths, and AgentRaft achieves high detection accuracy, outperforming baselines by 87.24%.
Over half of LLM agent tool interactions leak sensitive data, and AgentRaft can catch them with high accuracy.
The rapid integration of Large Language Model (LLM) agents into autonomous task execution has introduced significant privacy concerns within cross-tool data flows. In this paper, we systematically investigate and define a novel risk termed Data Over-Exposure (DOE) in LLM Agent, where an Agent inadvertently transmits sensitive data beyond the scope of user intent and functional necessity. We identify that DOE is primarily driven by the broad data paradigms in tool design and the coarse-grained data processing inherent in LLMs. In this paper, we present AgentRaft, the first automated framework for detecting DOE risks in LLM agents. AgentRaft combines program analysis with semantic reasoning through three synergistic modules: (1) it constructs a Cross-Tool Function Call Graph (FCG) to model the interaction landscape of heterogeneous tools; (2) it traverses the FCG to synthesize high-quality testing user prompts that act as deterministic triggers for deep-layer tool execution; and (3) it performs runtime taint tracking and employs a multi-LLM voting committee grounded in global privacy regulations (e.g., GDPR, CCPA, PIPL) to accurately identify privacy violations. We evaluate AgentRaft on a testing environment of 6,675 real-world agent tools. Our findings reveal that DOE is indeed a systemic risk, prevalent in 57.07% of potential tool interaction paths. AgentRaft achieves a high detection accuracy and effectiveness, outperforming baselines by 87.24%. Furthermore, AgentRaft reaches near-total DOE coverage (99%) within only 150 prompts while reducing per-chain verification costs by 88.6%. Our work provides a practical foundation for building auditable and privacy-compliant LLM agent systems.