Search papers, labs, and topics across Lattice.
This paper introduces MyPCBench, a benchmark designed to evaluate computer-use agents as personal assistants in a simulated Linux desktop environment populated with 17 real-world web applications. By defining 184 tasks based on actual user requests, the study benchmarks six models, revealing that Claude Opus 4.6 is the only model to exceed a 50% task completion rate, solving 55.4% of the tasks. The findings highlight significant challenges for models in handling tasks that require extensive personalization and coordination across multiple applications.
Claude Opus 4.6 outperforms its peers, solving over half of the complex tasks in a personalized desktop environment, revealing critical gaps in current AI capabilities.
Current benchmarks for computer-use agents evaluate models in impersonal environments. This leaves a gap between evaluation and deployment where personal assistants are expected to work across a user's whole digital life, including their context, historical data, and logged-in accounts. This gap is widest on web tasks, where live web evaluations cannot exercise sites that require logging in or personal information, the kind of site a real personal assistant has to drive. We introduce MyPCBench, which tests computer-use agents as personal assistants on a Linux desktop populated with 17 simulated real-world web applications and a full desktop stack, all seeded for one canonical persona, Michael Scott from The Office. We define 184 tasks in this environment, each inspired by a real request drawn from the OpenClaw community, and benchmark six closed and open-weight models with a uniform computer+bash tool surface. We find that the best model, Claude Opus 4.6, fully solves 55.4\% of the tasks, the only model above 50\%. Model failures cluster on tasks that span many applications and on long trajectories, where personalization stresses an assistant the most. We release the environment, task set, and agent harness at https://mypcbench.com.
CMU ML