Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a meta-optimization framework for tuning Bayesian Optimization (BO) algorithm hyperparameters by leveraging Gaussian Process (GP) inference on initial data. By treating cumulative regret on GP-inferred sample paths as the objective, an outer BO procedure efficiently identifies hyperparameter configurations expected to yield superior performance. Experiments confirm that this approach effectively selects parameters that outperform a range of alternatives.
Optimizing BO hyperparameters with BO itself reveals configurations that significantly reduce cumulative regret on GP-inferred sample paths.
Bayesian optimization (BO) is widely used as a standard approach for expensive black-box optimization. However, BO algorithms often involve parameters that must be specified in advance, and their performance can strongly depend on these choices. We propose a framework for optimizing such parameters using sample paths drawn from a Gaussian process (GP) inferred from the information available at the start of BO. We use cumulative regret as the performance metric for a BO algorithm. By running the BO algorithm on the generated sample paths, we obtain an empirical estimate of its expected cumulative regret for a given parameter configuration. Optimizing this estimate allows us to identify parameter configurations that, given the currently available information, are expected to achieve low cumulative regret. Since this parameter optimization is itself a black-box optimization problem, we employ another BO procedure to solve it, which we refer to as outer BO. Through experiments, we demonstrate that the proposed framework can effectively select parameter configurations that achieve strong performance among a range of candidate configurations.