Search papers, labs, and topics across Lattice.
This paper introduces FeatFix, a method that enhances the efficiency of cached diffusion inference by reusing exact features computed during the verification process to correct local draft outputs. By replacing draft block outputs with verified exact outputs at specific layer-timestep sites, FeatFix significantly reduces downstream feature errors and accelerates the generation process. Experimental results demonstrate that FeatFix achieves up to 6.70x speedup compared to traditional methods while maintaining competitive output quality across various image and video models.
Reusing previously computed exact features can accelerate diffusion model inference by over 6x without sacrificing quality.
Diffusion models are widely used to generate high-quality images and videos, but their iterative denoising process remains computationally intensive. A growing class of training-free accelerators reduces this cost by reusing cached intermediate features or forecasting future ones. To control draft drift, these methods sometimes compute an exact block feature for verification. Yet the resulting exact feature is typically used only to measure discrepancy or guide a later decision and is then discarded. We find that this previously computed feature can instead be reused for correction. Forwarding it at the verification site resets the local draft residual and reduces downstream feature error. Based on this observation, we introduce FeatFix, a local exact-feature correction method for cached diffusion inference. FeatFix operates at a fixed sparse set of layer--timestep sites. At each selected site, it replaces the complete draft block output with the exact output computed from the same incoming state, avoiding token- or channel-level partial replacement and full-timestep recomputation. Experiments across four image and video backbones show that FeatFix consistently accelerates generation, achieving a speedup of up to $6.70\times$ over Vanilla while maintaining competitive output quality.