Search papers, labs, and topics across Lattice.
This paper presents Top-Two Pareto Front Thompson Sampling (TTPFTS), the first anytime algorithm for identifying Pareto optimal solutions in multi-objective multi-armed bandit settings, utilizing a Bayesian framework. The authors benchmark TTPFTS against leading fixed-budget algorithms and showcase its effectiveness in a complex molecular discovery task, where it adeptly navigates a vast synthesis-on-demand molecular library. Additionally, they introduce a novel uncertainty quantification metric that accurately reflects the algorithm's confidence in its predictions, supported by theoretical proof of its asymptotic correctness.
TTPFTS not only outperforms existing methods in efficiency but also introduces a groundbreaking uncertainty quantification metric that enhances decision-making in complex environments.
Identifying Pareto optimal solutions is critical to support multi-objective decision-making. We introduce the first anytime Multi-Objective Multi-Armed Bandit algorithm for the Pareto Set Identification problem, taking a Bayesian approach: Top-Two Pareto Front Thompson Sampling (TTPFTS). We benchmark TTPFTS against state-of-the-art fixed-budget Pareto Set Identification algorithms on synthetic environments. Next, we demonstrate its practical utility in a challenging multi-objective molecular discovery setting by efficiently exploring an ultra-large synthesis-on-demand molecular library. Furthermore, we introduce a novel uncertainty quantification metric that estimates our algorithm's confidence in the predicted Pareto set. We demonstrate that this metric effectively proxies true performance, yielding a robust methodology for monitoring learning progress in complex settings. Finally, we complement these empirical findings with a theoretical proof of the algorithm's asymptotic correctness.
