Search papers, labs, and topics across Lattice.
The authors introduce Corecraft, a high-fidelity reinforcement learning environment simulating a customer support organization within the EnterpriseGym suite, designed to evaluate AI agents' ability to perform complex, real-world tasks. They trained GLM 4.6 using Group Relative Policy Optimization (GRPO) and adaptive clipping within Corecraft, demonstrating significant performance improvements on held-out evaluation tasks. Crucially, these improvements generalized to out-of-distribution benchmarks, suggesting that environment realism, diversity, and expert-authored rubrics are critical for training generalizable agents.
Training agents in a realistic, high-fidelity enterprise simulation boosts performance on out-of-distribution tasks, suggesting a path to more generalizable AI.
We show that training AI agents on high-fidelity reinforcement learning environments produces capabilities that generalize beyond the training distribution. We introduce \corecraft{}, the first environment in \textsc{EnterpriseGym}, Surge AI's suite of agentic RL environments. \corecraft{} is a fully operational enterprise simulation of a customer support organization, comprising over 2,500 entities across 14 entity types with 23 unique tools, designed to measure whether AI agents can perform the multi-step, domain-specific work that real jobs demand. Frontier models such as GPT-5.2 and Claude Opus 4.6 solve fewer than 30\% of tasks when all expert-authored rubric criteria must be satisfied. Using this environment, we train GLM~4.6 with Group Relative Policy Optimization (GRPO) and adaptive clipping. After a single epoch of training, the model improves from 25.37\% to 36.76\% task pass rate on held-out evaluation tasks. More importantly, these gains transfer to out-of-distribution benchmarks: +4.5\% on BFCL Parallel, +7.4\% on $τ^2$-Bench Retail, and +6.8\% on Toolathlon (Pass@1). We believe three environment properties are consistent with the observed transfer: task-centric world building that optimizes for diverse, challenging tasks; expert-authored rubrics enabling reliable reward computation; and enterprise workflows that reflect realistic professional patterns. Our results suggest that environment quality, diversity, and realism are key factors enabling generalizable agent capabilities.
