Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
StarHarness is a novel framework designed to evolve environment-specific agent harnesses while keeping model weights fixed, enhancing performance in enterprise settings. By stratifying tasks based on baseline failure behavior and employing a compact evolution pool, the framework achieves significant improvements in benchmark performance, yielding 20-35 percentage points over default harnesses after just a few accepted changes. Notably, these enhancements are robust, transferring effectively across different model families and remaining effective even on tasks not included in the evolution process.
Evolving agent harnesses can boost performance by up to 35% in enterprise environments, even with fixed model weights.
We present StarHarness, a framework for evolving environment-specific agent harnesses while keeping model weights fixed. The evolved harness can include prompt and task framing, tool interfaces, skills, MCP-backed providers, subagent structure, and agent-loop configuration. StarHarness constructs a compact evolution pool by stratifying tasks according to baseline failure behavior, separates proposer-visible search tasks from proposer-hidden selection tasks, and reserves held-out tasks for evaluating generalization. Across ITBench SRE, EnterpriseOps-Gym ITSM, and AutomationBench Finance, harness evolution improves full-benchmark performance by 20-35 percentage points over the default harness after 4-12 accepted changes per environment. These gains persist on tasks excluded from evolution and transfer without re-evolution across GPT and Qwen model families. Trace analysis links the improvements to interface repairs, environment conventions, and operational knowledge that compresses search, with fewer false-positive diagnoses and shorter trajectories in several settings. StarHarness therefore offers a practical way to reduce persistent model-environment mismatch in tool-rich enterprise tasks.
Mila