Search papers, labs, and topics across Lattice.
This paper introduces a Bayesian control framework for coding agents that optimizes tool-use decisions by treating orchestration as cost-sensitive sequential hypothesis testing. By maintaining a belief over candidate correctness, the controller dynamically decides whether to gather more evidence, refine candidates, or verify them, particularly excelling in scenarios where verification is expensive. The approach demonstrates superior performance across six generators and nine coding benchmarks, yielding interpretable correctness scores that surpass traditional metrics for uncertainty quantification.
Bayesian control outperforms traditional orchestration methods, especially when verification costs are high, by providing a more nuanced understanding of candidate correctness.
Modern coding agents pair LLM generators with various tools, including cheap diagnostics and expensive verifiers. The tool-use decisions are typically governed by orchestrators that often use fixed rules and ignore uncertainty. We formulate orchestration as cost-sensitive sequential hypothesis testing: a Bayesian controller maintains a belief over candidate correctness and dynamically decides whether to gather more evidence, refine the candidate, verify it, or stop. Across six generators and nine coding benchmarks, Bayesian control proves to be most valuable when verification is costly and critics are informative but imperfect. Beyond control, the belief state yields an interpretable correctness score that outperforms token-probability and raw tool-success baselines for uncertainty quantification.
