Search papers, labs, and topics across Lattice.
This paper introduces Perceptual Flow Matching (PFM), a novel framework that enhances few-step generation in flow-matching models by supervising flow matching in a perceptual feature space instead of the conventional VAE latent space. By leveraging pretrained perceptual models, PFM significantly reduces the number of sampling steps required for high-quality generation from 35-50 to just 4-8, while also minimizing artifacts compared to existing methods. The findings suggest that perceptual supervision can shift the regression minimizer towards mode-seeking behavior, improving the accuracy of predictions during coarse few-step integration and offering a new direction for efficient generative modeling research.
Reducing sampling steps from 50 to just 8 without sacrificing quality could revolutionize how we approach generative modeling.
We propose Perceptual Flow Matching (PFM), a simple yet effective framework for few-step generation in flow-matching models. Rather than performing velocity regression in the conventional VAE latent space, PFM supervises flow matching in a perceptual feature space using pretrained perceptual models. This simple change substantially improves the few-step generation capability of flow-matching models, reducing the number of sampling steps from 35-50 to 4-8 while preserving generation quality. Unlike existing acceleration and distillation approaches, PFM requires neither teacher models nor auxiliary score networks and can be integrated into standard flow-matching training pipelines with minimal modifications. Extensive experiments on image generation, video generation, and image editing tasks demonstrate that PFM consistently produces high-quality results while producing fewer artifacts than existing distillation-based methods. We further show that perceptual supervision shifts the regression minimizer from mean-seeking to mode-seeking, biasing predictions toward on-manifold modes that remain accurate under coarse few-step integration. Our results reveal that standard flow-matching training can naturally yield high-quality few-step generators when supervised in an appropriate representation space. We hope this insight inspires future research into representation-aware objectives for efficient generative modeling.
Tsinghua AI