Search papers, labs, and topics across Lattice.
The paper introduces EnterpriseClawBench, a benchmark designed for evaluating enterprise agents based on real-world workplace sessions. By leveraging a large archive of proprietary data, the benchmark generates 852 reproducible tasks that include various contextual elements such as role classes and semantic rubrics. Key findings reveal that the highest-performing configuration achieves only a score of 0.663, underscoring the complexity of evaluating enterprise agents and the necessity for a multifaceted assessment approach rather than a singular performance metric.
Enterprise agents struggle to achieve high performance in real-world tasks, with the best benchmark score only reaching 0.663, highlighting significant evaluation gaps.
Enterprise agents increasingly operate inside workspaces: they read heterogeneous files, invoke tools, and deliver business artifacts. We introduce EnterpriseClawBench, an enterprise agent benchmark constructed from proprietary, real-world agent sessions. Starting from a large archive of workplace sessions, the EnterpriseClawBench produces 852 reproducible tasks, each paired with recovered fixtures, rewritten prompts, role classes, skill subclasses, hard rules, and semantic rubrics. Because the sessions contain internal enterprise content, we do not release the benchmark data; instead, our reusable contribution is the construction and evaluation protocol. On EnterpriseClawBench, the best configuration reaches only 0.663 (Codex with GPT-5.5). These results show that enterprise agent evaluation must report harness--model combinations, artifact delivery, visual quality, cost, runtime, and skill-transfer behavior, rather than collapsing performance into a single score. Code: https://github.com/FrontisAI/EnterpriseClawBench
