Search papers, labs, and topics across Lattice.
This paper introduces $\alpha$-GaBO, a novel Bayesian optimization (BO) algorithm family designed for optimizing functions over the probability simplex. It leverages information geometry to construct Matérn kernels and geometric optimizers that respect the simplex's Riemannian metric. Experiments on benchmark functions and real-world applications like mixture optimization and robotic control demonstrate superior performance compared to Euclidean-based constrained BO methods.
By respecting the intrinsic geometry of the probability simplex, $\alpha$-GaBO significantly outperforms standard Bayesian optimization in tasks involving probabilities and mixtures.
Bayesian optimization is a data-efficient technique that has been shown to be extremely powerful to optimize expensive, black-box, and possibly noisy objective functions. Many applications involve optimizing probabilities and mixtures which naturally belong to the probability simplex, a constrained non-Euclidean domain defined by non-negative entries summing to one. This paper introduces $α$-GaBO, a novel family of Bayesian optimization algorithms over the probability simplex. Our approach is grounded in information geometry, a branch of Riemannian geometry which endows the simplex with a Riemannian metric and a class of connections. Based on information geometry theory, we construct Matérn kernels that reflect the geometry of the probability simplex, as well as a one-parameter family of geometric optimizers for the acquisition function. We validate our method on benchmark functions and on a variety of real-world applications including mixtures of components, mixtures of classifiers, and a robotic control task, showing its increased performance compared to constrained Euclidean approaches.
