Search papers, labs, and topics across Lattice.
This paper derives tighter instantaneous regret bounds for GP-UCB, enabling the creation of $(\epsilon, \delta)$-optimal stopping criteria for Bayesian Optimization. The proposed stopping criteria guarantee an $\epsilon$-optimal solution with high probability $1-\delta$ upon termination, addressing a key limitation of fixed-budget BO. Empirical validation demonstrates the effectiveness and efficiency of the proposed criteria in reducing unnecessary evaluations.
Stop wasting compute: this work delivers a practical, provably optimal way to terminate Bayesian Optimization.
Bayesian optimization (BO) is a widely used iterative black-box optimization method that utilizes Gaussian process (GP) surrogate models. In practice, BO is typically terminated after a fixed evaluation budget is exhausted, which can incur unnecessary cost and provides no optimality guarantee on solution quality. Recent research in developing a practical stopping criterion has made empirical progress, yet a theoretically sound stopping criterion remains a work in progress. In this work, we present provably tighter instantaneous regret bounds for GP upper confidence bound (GP-UCB) at any given iteration. Then, we propose stopping criteria for GP-UCB based on this tighter bound that ensures an $ε$-optimal solution with high probability $1-δ$ upon termination. Numerical experiments are performed to validate and demonstrate the effectiveness and efficiency of our stopping criteria.
