Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
The authors formalize test-time environment engineering by having a "Builder" model induce reusable "Meta-Skills"—actionable principles governing when and how to scaffold execution—from a "Target" agent's feedback traces on a development set. Across Harness-Bench and NewtonBench, using this frozen meta-skill bank to synthesize execution harnesses improves Target accuracy by 8.95 percentage points over naive construction and beats directly prompt-feeding the bank to the Target by 12.02 points. Crucially, these performance gains hold even when the Builder and Target share identical model weights, validating that agents can achieve meaningful test-time self-improvement purely through environment manipulation.
Translating learned strategic principles into an external runtime harness yields a 12-point performance boost over directly feeding those same principles into an agent's context window.
Agent performance depends on both reasoning ability and the environment in which it acts. We study test-time AI-for-AI, asking how a Builder can learn to construct better execution environments for a Target while both models' weights remain fixed. To make the Builder's experience reusable, we introduce Meta-Skill: principles specifying when support is needed and what resources to provide. The Builder learns these principles from Target's execution feedback on the development set, then uses the frozen skill bank to construct harnesses for unseen tasks. Across Harness-Bench and NewtonBench, full-bank meta-skills improve macro-average performance by 8.95 percentage points over no-skill construction, and 12.02 points over direct delivery of the same bank to the Target. These results highlight the value of translating experience into executable support. Gains when the same model serves both roles further suggest a path to system level self-improvement through learning to build better environments.