Search papers, labs, and topics across Lattice.
This paper introduces ACID, a novel adaptive caching mechanism for video diffusion models that dynamically adjusts the threshold for caching based on the rate of change in the drift signal during denoising. By selectively applying a low threshold at critical timesteps and caching aggressively elsewhere, ACID achieves significant improvements in inference speed without sacrificing visual quality. Evaluations show that ACID can provide up to 2.16x speedup over non-caching methods and up to 38% additional speedup compared to traditional fixed-threshold approaches, with minimal quality degradation.
ACID redefines the caching paradigm in video generation, achieving unprecedented speedups while maintaining visual fidelity by dynamically adjusting thresholds based on drift signals.
Video diffusion models produce high-quality generations but remain slow at inference due to their sequential denoising procedure. Caching-based acceleration methods address this by reusing intermediate model outputs: leading dynamic approaches such as TeaCache, EasyCache, and DiCache accumulate a drift signal and skip expensive model evaluations when accumulated drift stays below a fixed threshold 蟿. This threshold controls an apparent tradeoff - raising it yields faster generation at the cost of visual quality, while lowering it preserves quality but sacrifices speed. We show this tradeoff is not fundamental; it is an artifact of holding 蟿 constant throughout denoising. We identify the existence of critical steps - timesteps where the drift signal changes rapidly - and show that applying a low threshold selectively at these steps while caching aggressively elsewhere recovers most of the quality of conservative caching at substantially higher inference speeds. Building on this insight, we propose ACID, a lightweight, training-free wrapper that monitors the rate of change of each method's existing drift signal to dynamically switch between a low and a high threshold. ACID is signal-agnostic and modular: it requires no retraining and plugs directly into existing dynamic caching methods without modifying their core mechanisms. Evaluated across three caching methods (TeaCache, EasyCache, DiCache) and three open-source video diffusion models (HunyuanVideo, Wan 2.1, CogVideoX), ACID consistently expands the Pareto frontier of visual quality versus inference speed beyond what any fixed threshold achieves. In particular, on TeaCache and HunyuanVideo, ACID achieves up to 2.16x speedup over the no-caching baseline, and up to 38% additional speedup over the conservative fixed-threshold baseline with negligible (<0.3 dB PSNR, <0.01 SSIM, <0.01 LPIPS) quality degradation.
