Search papers, labs, and topics across Lattice.
The paper introduces PAC-Bench, a benchmark designed to evaluate multi-agent collaboration performance under varying privacy constraints. Experiments using PAC-Bench reveal that privacy constraints significantly degrade collaboration performance and shift outcome dependence towards the initiating agent. The degradation is attributed to coordination breakdowns such as privacy violations, conservative abstraction, and privacy-induced hallucinations, highlighting the need for novel coordination mechanisms.
Privacy constraints don't just hinder multi-agent collaboration鈥攖hey fundamentally alter the dynamics, making outcomes more dependent on who initiates the interaction.
We are entering an era in which individuals and organizations increasingly deploy dedicated AI agents that interact and collaborate with other agents. However, the dynamics of multi-agent collaboration under privacy constraints remain poorly understood. In this work, we present $PAC\text{-}Bench$, a benchmark for systematic evaluation of multi-agent collaboration under privacy constraints. Experiments on $PAC\text{-}Bench$ show that privacy constraints substantially degrade collaboration performance and make outcomes depend more on the initiating agent than the partner. Further analysis reveals that this degradation is driven by recurring coordination breakdowns, including early-stage privacy violations, overly conservative abstraction, and privacy-induced hallucinations. Together, our findings identify privacy-aware multi-agent collaboration as a distinct and unresolved challenge that requires new coordination mechanisms beyond existing agent capabilities.
