Search papers, labs, and topics across Lattice.
This paper introduces Multi-Source Causal Bayesian Optimization (MSCBO), an algorithm that integrates Multi-Source Bayesian Optimization (MSBO) with Causal Bayesian Optimization (CBO) to handle variable dependencies and leverage multiple information sources in black-box optimization. MSCBO uses causal principles to model variable dependencies across multiple information sources, enabling more efficient optimization, improved decision-making, and reduced computational complexity. Experiments on synthetic and real-world datasets demonstrate that MSCBO improves convergence speed, performance, and scalability compared to MSBO and CBO.
By fusing multi-source optimization with causal reasoning, MSCBO slashes dimensionality and operational costs, leading to faster convergence and better performance in complex optimization tasks.
Multi-Source Bayesian Optimization (MSBO) serves as a variant of the traditional Bayesian Optimization (BO) framework applicable to situations involving optimization of an objective black-box function over multiple information sources such as simulations, surrogate models, or real-world experiments. However, traditional MSBO assumes the input variables of the objective function to be independent and identically distributed, limiting its effectiveness in scenarios where causal information is available and interventions can be performed, such as clinical trials or policy-making. In the single-source domain, Causal Bayesian Optimization (CBO) extends standard BO with the principles of causality, enabling better modeling of variable dependencies. This leads to more accurate optimization, improved decision-making, and more efficient use of low-cost information sources. In this article, we propose a principled integration of the MSBO and CBO methodologies in the multi-source domain, leveraging the strengths of both to enhance optimization efficiency and reduce computational complexity in higher-dimensional problems. We present the theoretical foundations of both Causal and Multi-Source Bayesian Optimization, and demonstrate how their synergy informs our Multi-Source Causal Bayesian Optimization (MSCBO) algorithm. We compare the performance of MSCBO against its foundational counterparts for both synthetic and real-world datasets with varying levels of noise, highlighting the robustness and applicability of MSCBO. Based on our findings, we conclude that integrating MSBO with the causality principles of CBO facilitates dimensionality reduction and lowers operational costs, ultimately improving convergence speed, performance, and scalability.
