Search papers, labs, and topics across Lattice.
This paper introduces a contextual Stackelberg game framework to govern resource allocation in multi-turn large language model (LLM) agents, addressing the limitations of static thresholds in dynamic task environments. By formulating a leader-follower model where a controller sets quality targets and cost incentives, and an executor optimizes resource actions, the authors achieve a 17.4% reduction in mean token cost compared to a conservative baseline, while maintaining quality. The findings highlight the potential for adaptive resource management in LLMs, with theoretical guarantees for equilibrium and stability under specific conditions.
A novel Stackelberg game approach cuts LLM token costs by 17.4% without sacrificing quality, challenging traditional static resource management methods.
Large language model (LLM) agents increasingly operate as multi-turn systems that must allocate context, prompt verbosity, and tool access under finite computational budgets. Static thresholds are simple, but they are brittle under heterogeneous tasks and evolving session states. We formulate resource governance as a contextual Stackelberg game: a controller commits to a quality target and a cost incentive, while an executor responds with resource actions over context, prompting, and tool usage. We learn a conditional response model, optimize a leader policy against that model, and repair the resulting policy using real-API calibration and projection onto an empirically selected action set. For the restricted game, we establish conditional guarantees for equilibrium existence, follower-response stability, safe-set projection, and transfer from a surrogate environment to the real environment under bounded value error. The primary real-API experiment comprises 300 evaluated turns. Relative to a conservative baseline, the selected repaired controller reduces mean token cost by 17.4% (Welch $p=0.022$), while the measured quality difference is not statistically significant ($p=0.44$). The theoretical results are conditional and the experiments do not estimate their regret or transfer constants; consequently, the evidence establishes a promising repaired operating point, not a certified real-system equilibrium.
