Search papers, labs, and topics across Lattice.
This survey paper provides a comprehensive review of Bayesian quadrature (BQ), a probabilistic approach to numerical integration. It systematizes BQ methods by classifying them along the axes of modeling, inference, and sampling, and consolidates theoretical guarantees. The paper also includes a numerical study demonstrating the impact of different choices within the taxonomy and offers a practical assessment of the challenges and limitations of BQ.
Bayesian quadrature, a powerful but often overlooked method for intractable integrals, gets a comprehensive treatment that could revitalize its use in machine learning and beyond.
Bayesian quadrature is a probabilistic, model-based approach to numerical integration, the estimation of intractable integrals, or expectations. Although Bayesian quadrature was popularised already in the 1980s, no systematic and comprehensive treatment has been published. The purpose of this survey is to fill this gap. We review the mathematical foundations of Bayesian quadrature from different points of view; present a systematic taxonomy for classifying different Bayesian quadrature methods along the three axes of modelling, inference, and sampling; collect general theoretical guarantees; and provide a controlled numerical study that explores and illustrates the effect of different choices along the axes of the taxonomy. We also provide a realistic assessment of practical challenges and limitations to application of Bayesian quadrature methods and include an up-to-date and nearly exhaustive bibliography that covers not only machine learning and statistics literature but all areas of mathematics and engineering in which Bayesian quadrature or equivalent methods have seen use.
