Search papers, labs, and topics across Lattice.
This paper introduces MeanFlowNFT, a novel approach that integrates reinforcement learning (RL) with MeanFlow generators to optimize average velocity sampling for efficient few-step generation. By leveraging the DiffusionNFT framework, the authors construct an instantaneous-velocity predictor that maintains the speed of MeanFlow while ensuring well-defined reward optimization. Experimental results demonstrate that MeanFlowNFT significantly outperforms existing state-of-the-art RL-tuned generators, achieving superior performance with fewer sampling steps in both image and video generation tasks.
MeanFlowNFT achieves superior few-step generation performance, outperforming traditional multi-step RL-tuned methods while maintaining efficiency.
MeanFlow generators achieve fast few-step sampling by predicting average velocities over time intervals, making them attractive for efficient generation. Reinforcement learning (RL) has become a powerful way to align diffusion and flow models with human preferences and task-specific objectives. In particular, DiffusionNFT offers an efficient forward-process RL framework that does not require reverse-process trajectories or likelihood estimation. However, applying such RL methods to MeanFlow remains underexplored. DiffusionNFT optimizes instantaneous velocities, whereas MeanFlow samples with average velocities. To bridge this gap, we introduce MeanFlowNFT. Inspired by the MeanFlow identity, which bridges average and instantaneous velocities, we construct an induced instantaneous-velocity predictor. We apply the DiffusionNFT objective to this predictor, making reward optimization well-defined for MeanFlow. Sampling remains based on the average velocity, preserving MeanFlow's fast few-step generation. We further prove that MeanFlowNFT inherits DiffusionNFT's strict policy-improvement guarantee. Experiments on image and video generation show that MeanFlowNFT consistently improves baselines. Moreover, it outperforms prior state-of-the-art RL-tuned few-step generators on most metrics ($6$ of $8$ on SD3.5-M), and can even surpass multi-step RL-tuned diffusion while using only a few sampling steps. For instance, on Wan 2.1, $4$-step MeanFlowNFT reaches a VBench score of $84.33$, surpassing $50$-step LongCat-Video RL ($82.57$).
