Search papers, labs, and topics across Lattice.
This paper introduces Action-BED, a novel framework for Bayesian experimental design that reformulates the optimization of expected uncertainty reductions into a task-driven approach based on expected future loss (EFL). By leveraging singly intractable objectives, Action-BED enables the joint optimization of design and downstream action policies using stochastic gradients, eliminating the need for complex posterior or marginal likelihood estimations. The key result demonstrates that this method allows for more effective and efficient learning of design policies tailored to specific tasks, significantly improving customization and simplicity compared to traditional BED approaches.
Task-driven Bayesian experimental design just got a major upgrade, enabling efficient learning of design policies without the complexity of posterior estimation.
Bayesian experimental design (BED) has traditionally been based on maximising expected uncertainty reductions from prior to posterior. A major shortfall of this approach is that it leads to doubly intractable objectives that are difficult to optimise, while customising them to particular downstream tasks of interest can also be difficult. Following first principles decision theory, we demonstrate that BED can alternatively be formulated in terms of an expected future loss (EFL) on downstream actions, providing a simple and naturally task-driven framework. Critically, we then show that all such EFLs can be rearranged into singly intractable objectives that can be jointly optimised with respect to both the design policy and a downstream action policy using stochastic gradients, an approach we refer to as ACTION-BED. This formulation further sidesteps the need for any explicit posterior or marginal likelihood estimation and is naturally implicit, requiring only the ability to sample from the joint model over model parameters and data, and evaluate the downstream loss function. It thus allows design policies to be learned more effectively, efficiently, and simply than existing methods, while providing easy customisation to different downstream tasks and losses.
