Search papers, labs, and topics across Lattice.
This paper introduces a post-training quantization framework, Timestep-Aware SVDQuant-GPTQ, to address the challenges of W4A4 quantization in large video diffusion Transformers, specifically Wan2.2-I2V. The method combines SVDQuant for outlier compensation, GPTQ for weight quantization, and timestep-bin-wise activation clipping, tailored independently for each Mixture-of-Experts expert. Results on OpenS2V-Eval show a 59.3% reduction in peak GPU memory with minimal performance degradation (0.9% VBench, 2.3% Imaging Quality), highlighting the importance of expert- and timestep-aware calibration.
Quantizing video diffusion models to W4A4 doesn't have to tank performance: expert- and timestep-aware calibration unlocks 59% memory savings with negligible quality loss.
W4A4 quantization of large video diffusion Transformers offers substantial memory savings but is hindered by two main challenges: sparse large-magnitude activation outliers, and strongly timestep-dependent activation distributions across the multi-step denoising trajectory. These difficulties are compounded by Wan2.2-I2V's two-expert Mixture-of-Experts DiT design, whose high-noise and low-noise experts exhibit distinct quantization sensitivities that a single global calibration policy cannot capture. We propose a post-training quantization framework combining SVDQuant-based low-rank outlier compensation, GPTQ-based reconstruction-aware residual weight quantization, and timestep-bin-wise per-layer activation clipping-ratio search conducted independently for each expert. On the OpenS2V-Eval benchmark, our method reduces peak GPU memory by 59.3\% relative to the BF16 baseline while incurring only a 0.9\% drop in VBench average score and a 2.3\% drop in Imaging Quality, demonstrating that expert- and timestep-aware calibration is essential for high-fidelity W4A4 inference on MoE video DiTs.
