Search papers, labs, and topics across Lattice.
This paper introduces Flow Divergence Sampler (FDS), a training-free refinement framework for flow-based generative models that addresses issues arising from conflicting sample-wise velocities during inference. FDS leverages the divergence of the marginal velocity field, computable during inference, to identify and correct intermediate states that are being misguided towards low-density regions. Experiments across text-to-image synthesis and inverse problems demonstrate that FDS consistently improves generation fidelity without requiring additional training or modifications to the underlying flow model architecture.
Flow-based generative models can be improved *after* training, simply by steering intermediate states away from regions where the velocity field is highly divergent.
Flow-based models learn a target distribution by modeling a marginal velocity field, defined as the average of sample-wise velocities connecting each sample from a simple prior to the target data. When sample-wise velocities conflict at the same intermediate state, however, this averaged velocity can misguide samples toward low-density regions, degrading generation quality. To address this issue, we propose the Flow Divergence Sampler (FDS), a training-free framework that refines intermediate states before each solver step. Our key finding reveals that the severity of this misguidance is quantified by the divergence of the marginal velocity field that is readily computable during inference with a well-optimized model. FDS exploits this signal to steer states toward less ambiguous regions. As a plug-and-play framework compatible with standard solvers and off-the-shelf flow backbones, FDS consistently improves fidelity across various generation tasks including text-to-image synthesis, and inverse problems.
