Search papers, labs, and topics across Lattice.
This paper investigates the necessity of prescribed optimization pipelines in self-evolving agents by introducing Open-Ended Optimization (OEO), which allows a frontier model to compose its improvement process online while maintaining fixed objectives and constraints. Through 14 comparisons across various benchmark-target-model settings, OEO, driven by GPT-5.5, outperformed traditional methods in 12 instances, demonstrating significant efficiency by utilizing only 34.3% of the token budget allocated to SkillOpt. The findings suggest that while prescribed pipelines can enhance optimization consistency, a sufficiently capable optimizer can autonomously navigate the improvement process, challenging the reliance on rigid frameworks.
OEO shows that a capable optimizer can outperform traditional pipelines, achieving 12 wins in 14 comparisons while using significantly fewer resources.
Self-evolving agents are usually built around prescribed optimization pipelines: the framework decides how to gather evidence, revise a persistent artifact, select candidates, and stop. We ask whether this task-specific procedure remains necessary when a frontier model acts as the optimizer. We introduce Open-Ended Optimization (OEO), which keeps the objective, permitted interactions, resource budget, data boundary, and evaluation fixed while allowing the optimizer to compose the improvement process online. We compare OEO with two complementary prescribed approaches: SkillOpt, a staged pipeline with bounded edits, and GEPA, a reflective evolutionary search. Across 14 head-to-head comparisons over 8 benchmark-target-model settings, GPT-5.5-driven OEO records 12 wins, 1 tie, and 1 narrow loss of 0.21 percentage points. It uses a median 34.3 percent of SkillOpt's configured target-interaction token budget. A one-shot, zero-interaction control shows that the gains are not explained by a single prior-driven rewrite. However, delegation has a capability boundary: SkillOpt outperforms OEO with a medium optimizer, and a weak optimizer cannot operate through the unchanged OEO interface. In the fully instrumented OEO-SkillOpt pair, trajectory analysis further shows that prescription changes how optimization proceeds more consistently than it changes final behavior. Together, these findings recast prescribed pipelines as capability-dependent scaffolding: essential constraints remain external, but a sufficiently capable optimizer can compose the route from measurable feedback to persistent improvement.
Microsoft Research