Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces Flow Matching for Thompson-Sampling Refinement (FMTR), an amortized approach for batch black-box optimization that learns a history-conditioned proposal distribution to sample variable-size batches offline. FMTR addresses the challenge of constructing effective batches in expensive, parallelizable evaluation settings by refining Thompson-sampling argmaxes towards high-value regions using a horizon-dependent Langevin pushforward map. The method achieves competitive performance against existing batch BO and in-context baselines on synthetic and real-world benchmarks while significantly reducing the computational overhead of batch selection at test time.
Amortized batch black-box optimization via flow matching generates variable-size batches in constant time, outperforming traditional methods on expensive optimization tasks.
Batch black-box optimization is important for expensive systems where many candidates can be evaluated in parallel, yet only a few rounds of evaluation are affordable. In this regime, effective batch construction must identify multiple promising regions while avoiding redundant evaluations, and conventional Bayesian optimization can require increasingly difficult batch-selection procedures as the batch size grows. We introduce Flow Matching for Thompson-Sampling Refinement (FMTR), an amortized approach that learns offline a continuous, history-conditioned proposal distribution from which variable-size batches can be sampled. FMTR is trained offline by conditional flow matching on Thompson-sampling argmaxes refined toward high-value regions via a horizon-dependent Langevin pushforward map, adapting the exploration-exploitation tradeoff over the optimization horizon. At test time, the model parameters remain fixed and batch generation requires neither task-specific surrogate refitting nor numerical acquisition optimization. FMTR achieves strong performance against batch BO and in-context baselines on synthetic and real-world benchmarks, while substantially reducing the computational cost of batch selection.