Search papers, labs, and topics across Lattice.
This paper introduces POLAR, a novel framework for adaptive data acquisition that leverages pretrained predictive models to create belief representations, effectively decoupling representation learning from policy learning. By utilizing these belief states, POLAR enhances the efficiency of policy learning in Bayesian experimental design, Bayesian optimization, and active learning tasks. Empirical results show that POLAR significantly outperforms existing amortized methods while requiring fewer training samples, marking a substantial advancement in scalable data acquisition strategies.
POLAR achieves superior performance in adaptive data acquisition by harnessing pretrained models, requiring dramatically fewer training samples than existing methods.
Learning effective policies for adaptive data acquisition remains challenging: posterior-based methods rely on surrogate models and posterior approximations that can be misspecified or biased, while direct policy-learning methods map from historical observations and fail to exploit available model representations, making learning harder. We introduce policy learning with belief representations (POLAR), based on the insight that optimal data acquisition depends on the observation history only through a sufficient belief state. Specifically, POLAR decouples representation learning from policy learning by leveraging pretrained predictive foundation models as belief-state encoders, training a policy head on top of their representations. This yields a simple, unified amortised policy learning framework for Bayesian experimental design, Bayesian optimisation, and active learning, differing only in the task-specific utility used to train the policy. Empirically, we find that POLAR outperforms state-of-the-art amortised methods across diverse tasks while requiring far fewer training samples, demonstrating a significant step in the scalability and efficiency of amortised data acquisition.
