Search papers, labs, and topics across Lattice.
This paper presents a novel approach to evolutionary optimization of LLM prompts by decoupling the roles of the LLM, allowing for cost-effective evaluation through the use of a cheaper model for high-volume answering while reserving a stronger model for critical reflection and variation tasks. The method leverages upward cross-tier transfer to effectively deploy prompts evolved on lower-cost tiers to stronger models, achieving significant cost savings without sacrificing performance. The results demonstrate that this strategy can reduce search costs by 5.6-14x, and up to 25-54x in scenarios requiring extensive reasoning, while maintaining or exceeding the performance of traditional same-tier optimization methods across multiple tasks and model families.
Evolving LLM prompts on a budget can cut search costs by up to 54x without sacrificing performance, reshaping the economics of prompt optimization.
Evolutionary optimization of LLM prompts and agentic programs (e.g., GEPA) is dominated by fitness evaluation: scoring each candidate runs an answering LLM over a validation set, so the evaluator's price tier dictates total search cost. We restructure that search by decoupling the three roles an LLM plays, running the high-volume answering role on the cheapest tier, reserving a strong model for the rare reflection/variation operator, then exploiting upward cross-tier transfer to deploy the cheaply evolved prompt on a stronger target. We contribute a cost-controlled characterization of when cheap-tier search substitutes for target-tier search, and where it fails. Across four tasks (HotpotQA, IFBench, LiveBench-Math, HoVer) and eleven models in four model families, the resulting prompt matches or exceeds same-tier optimization while placing over 96% of search tokens on the cheapest tier, at 5.6-14x lower search cost, rising to 25-54x where reasoning tiers emit long chains of thought on every fitness call.
