Search papers, labs, and topics across Lattice.
This paper reinterprets the evidence lower bound as a continuous relaxation of neural set functions, allowing for the development of a surrogate objective that eliminates the need for Monte Carlo sampling in variational inference. By providing stable and efficient gradients, the proposed method significantly reduces computational overhead and accelerates inference in weakly supervised settings. Experimental results across various real-world tasks show consistent improvements over existing approaches, highlighting the effectiveness of this new framework for optimal subset oracle learning.
Surpassing traditional Monte Carlo methods, this approach offers a stable and efficient alternative for learning neural set functions, dramatically cutting down computational costs.
Learning neural set functions is pivotal to a wide range of important applications, including compound selection in AI-driven drug discovery and product recommendation. Recent work has introduced optimal subset oracles to implicitly learn set functions under practical weakly supervised settings, where model parameters are optimized through mean-field variational inference. However, these frameworks rely on Monte Carlo sampling to estimate gradients of the evidence lower bound when updating the variational distribution. Repeated sampling across iterations incurs substantial computational overhead, while the resulting stochasticity can destabilize the optimization trajectory. In this work, we reinterpret the evidence lower bound as a continuous relaxation of the set function and learn a surrogate objective that replaces sampling-based ELBO gradient estimation during variational optimization. The learned surrogate provides stable and efficient gradients throughout the continuous domain, thereby reducing computational overhead and accelerating inference. Furthermore, we establish an approximation guarantee for the proposed framework under submodular maximization and characterize its connection to variational free energy. Experiments on a variety of real-world tasks demonstrate consistent improvements over existing baselines.
NUS