Search papers, labs, and topics across Lattice.
WeClawArena is a novel auditable benchmark and sandbox designed to facilitate and evaluate cross-user agent collaboration within human-centered agent networks, addressing the lack of realistic environments for testing multi-party owned-agent interactions. The framework includes 124 base tasks across six domains, each with multiple scenario variants that allow for the assessment of both utility and attack success rates in collaborative tool-use contexts. Key findings reveal that the sandbox effectively records and audits interactions, enabling researchers to diagnose issues such as privacy leakage and invalid authority paths in agent collaboration scenarios.
WeClawArena reveals how cross-user agent collaboration can be systematically audited, exposing vulnerabilities in personal workspaces that could compromise user privacy and security.
Recent advances in persistent personal-agent frameworks are making human-centered agent networks realistic deployment targets: each user can be served by an AI agent that acts on the user's behalf, maintains state, and communicates with other agents through social and task relations. In these networks, everyday tool use becomes multi-party owned-agent collaboration over personal workspaces, where files, records, tools, and policies are not directly visible across owners. Existing agent benchmarks study tool use and collaboration, but they do not provide an end-to-end sandbox for verifiable cross-user agent collaboration with realistic user digital workspaces or test how harmful actions can travel through the human-centered agent network. We introduce WeClawArena, an auditable benchmark and runtime sandbox for multi-party owned-agent collaboration over personal workspaces. WeClawArena targets collaborative tool-use tasks in which personal workspaces serve as both operational tools and personal constraints. The benchmark contains 124 base tasks across six cross-user task domains and expands them into 620 scenario variants, with one benign control and four attack-vector variants per base task. The sandbox records peer messages, tool calls, resource operations, governed decisions, and final workspace states. WeClawArena reports utility and attack success rate separately and audits attack success from bounded runtime evidence, supporting diagnosis of task breakdown, privacy leakage, poisoned evidence, and invalid authority paths.
CMU ML