Search papers, labs, and topics across Lattice.
This paper introduces a training-free mixing policy to compose pre-trained GFlowNets for multi-objective generation, eliminating the need for retraining when objectives change. The method handles diverse reward combinations, including linear scalarization and non-linear logical operators, by composing pre-trained GFlowNets at inference time. The authors prove exact recovery of the target distribution for linear scalarization and quantify approximation quality for nonlinear operators, demonstrating comparable performance to training-based baselines on synthetic and molecular generation tasks.
Skip the retraining: compose pre-trained GFlowNets at inference time to tackle multi-objective generation, even with complex non-linear reward functions.
Generative Flow Networks (GFlowNets) learn to sample diverse candidates in proportion to a reward function, making them well-suited for scientific discovery, where exploring multiple promising solutions is crucial. Further extending GFlowNets to multi-objective settings has attracted growing interest since real-world applications often involve multiple, conflicting objectives. However, existing approaches require additional training for each set of objectives, limiting their applicability and incurring substantial computational overhead. We propose a training-free mixing policy that composes pre-trained GFlowNets at inference time, enabling rapid adaptation without finetuning or retraining. Importantly, our framework is flexible, capable of handling diverse reward combinations ranging from linear scalarization to complex non-linear logical operators, which are often handled separately in previous literature. We prove that our method exactly recovers the target distribution for linear scalarization and quantify the approximation quality for nonlinear operators through a distortion factor. Experiments on a synthetic 2D grid and real-world molecule-generation tasks demonstrate that our approach achieves performance comparable to baselines that require additional training.
