Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
FlashVSR+ enhances efficient video super-resolution by introducing a hybrid attention mechanism that leverages local correlations while preserving sparse global context, achieving significant speedups and reduced memory footprint for high-resolution inference. To align distilled models with human preferences, it proposes Reward-Yield Distribution Matching Distillation (Ry-DMD), a novel training strategy that incorporates black-box rewards without requiring backpropagation through the reward model. This combined approach results in improved restoration quality, substantially better high-resolution efficiency, and consistent gains in user preference, with Ry-DMD showing generalization potential to other generative tasks.
A single 24GB GPU can now perform untiled 4K VSR at 2x DiT speed, thanks to hybrid attention that balances local and global interactions.
Recent video super-resolution (VSR) models achieve efficient one-step generation through diffusion distillation. However, high-resolution inference remains costly, and distilled models are difficult to align with human preferences. These challenges call for improvements in both model architecture and training strategy. We present FlashVSR+ to address both limitations. On the architecture side, we introduce hybrid attention based on the strong locality observed in pretrained VSR models, while retaining sparse global interaction for long-range consistency. It achieves up to 2times DiT speedup and 45\% lower peak memory, enabling spatially untiled 4K VSR on a single 24GB RTX 4090. On the training side, we propose Reward-Yield Distribution Matching Distillation (Ry-DMD) for preference-aligned one-step generation. Ry-DMD uses reward-weighted teacher rollouts to incorporate black-box rewards into distribution matching, without backpropagating through the reward model. We further show that Ry-DMD generalizes beyond VSR to T2I generation. Together, FlashVSR+ delivers stronger restoration quality and substantially improves high-resolution efficiency, with consistent gains in user preference. We release our code, models, and training data at https://www.flashvsr.tech{FlashBlue{www.flashvsr.tech}}.
Tsinghua AI