Search papers, labs, and topics across Lattice.
This paper introduces CostAda, a cost-calibrated adaptive controller designed to optimize the discovery process in large language models by incorporating cost considerations into frontier utility. By addressing the limitations of existing adaptive discovery controllers that ignore the varying costs associated with different search actions, CostAda effectively balances exploration and exploitation within a fixed token budget. The results demonstrate that CostAda achieves superior quality outcomes with significantly reduced budget expenditures across multiple benchmarks, outperforming traditional methods in both efficiency and effectiveness.
CostAda achieves top-tier discovery quality while using at least 50% less budget compared to existing methods, revolutionizing how we approach resource allocation in LLM search processes.
Large language models increasingly support scientific and algorithmic discovery through inference-time search over evaluated candidates. Existing adaptive discovery controllers assign credit based only on score progress, even though prompt length, retries, and guidance calls cause search actions to incur different token costs. We prove that cost-blind credit can forfeit all but a vanishing fraction of attainable quality as frontiers multiply and costs diverge. Under a fixed search-side token budget, the controller must decide which frontier is improving and whether its gain justifies the realized cost before the budget is exhausted. We introduce \textbf{CostAda}, a cost-calibrated adaptive controller built around \emph{cost-calibrated frontier utility}. The utility values frontier progress relative to realized action cost and conditions that credit on the remaining budget. CostAda uses this signal to control local exploration intensity, frontier allocation, and budgeted tactic intervention. Cost and remaining budget therefore shape the search rather than serving only as accounting variables or a stopping rule. CostAda reaches the strongest baseline's full-budget quality with at most half the budget on twelve of sixteen benchmark--backbone pairs while achieving the strongest mean final quality on all eight benchmarks under GLM-5 and GPT-5.4.
