Search papers, labs, and topics across Lattice.
Harness-R1 introduces a novel approach to dynamically edit executable runtime harnesses based on agent failure trajectories, enabling agents to adapt their behavior post-deployment. By utilizing online reinforcement learning, the method trains a dedicated harness engineer to optimize edits for task success rather than relying on a static editing process. The results show a significant improvement in task success rates across multiple environments, with an increase from 44.3% to 53.6% for the vanilla Qwen3.5-9B model, and further enhancements with target-specific fine-tuning.
Harness-R1 achieves a remarkable 9.3 percentage point increase in task success rates by learning to edit agent harnesses in response to failure trajectories.
Agents built around large language models continually accumulate interaction trajectories during deployment, yet their behavior typically remains fixed. Beyond updating model weights, these trajectories can improve the agent harness that constructs context, mediates tools, validates actions, and recovers execution. We introduce Harness-R1, the first method, to our knowledge, that makes failure-conditioned, lifecycle-wide editing of an existing executable runtime a learned capability. It post-trains a dedicated harness engineer with online reinforcement learning so that its edits are optimized for the realized task success they produce, rather than proposed by a fixed editor. A separate 9B engineer converts batches of target-agent failures into validated executable patches; fresh same-batch reruns of the frozen target provide outcome rewards, so training updates only the engineer. Cold-start supervised fine-tuning initializes this editing policy, which is then trained online with group-relative policy optimization. Across WebShop, ALFWorld, and DBBench, Harness-R1 raises vanilla Qwen3.5-9B success from 44.3% to 53.6% (+9.3 percentage points). After direct target-agent fine-tuning, a target-specific engineer raises the average further from 59.2% to 64.2% (+5.0 points); because these gains hold both before and after fine-tuning the target, Harness-R1 points toward co-evolving the harness engineer and the target agent.
