Search papers, labs, and topics across Lattice.
This paper introduces LOOM-CFM, a method that improves the data-noise coupling in Conditional Flow Matching (CFM) by optimizing noise-data assignments across multiple minibatches during training. By extending the scope of minibatch optimal transport (OT), LOOM-CFM streamlines sampling trajectories, leading to faster inference. Experiments demonstrate that LOOM-CFM achieves a better speed-quality trade-off and facilitates high-resolution synthesis in latent space training.
Squeeze 2x more speed from your conditional flow matching models by optimizing data-noise coupling across minibatches.
Conditional Flow Matching (CFM), a simulation-free method for training continuous normalizing flows, provides an efficient alternative to diffusion models for key tasks like image and video generation. The performance of CFM in solving these tasks depends on the way data is coupled with noise. A recent approach uses minibatch optimal transport (OT) to reassign noise-data pairs in each training step to streamline sampling trajectories and thus accelerate inference. However, its optimization is restricted to individual minibatches, limiting its effectiveness on large datasets. To address this shortcoming, we introduce LOOM-CFM (Looking Out Of Minibatch-CFM), a novel method to extend the scope of minibatch OT by preserving and optimizing these assignments across minibatches over training time. Our approach demonstrates consistent improvements in the sampling speed-quality trade-off across multiple datasets. LOOM-CFM also enhances distillation initialization and supports high-resolution synthesis in latent space training.
