Search papers, labs, and topics across Lattice.
This paper introduces a novel ultra-low-bitrate image compression (ULB-IC) method that leverages a pretrained video diffusion model (VDM) to model the transition from a compact "anchor frame" to the final reconstructed image. By reinterpreting generative decoding as a next-frame prediction task conditioned on the anchor frame, the method improves fidelity and realism compared to image diffusion-based approaches. Experiments on CLIC2020 demonstrate over 50% bitrate savings across LPIPS, DISTS, FID, and KID compared to DiffC, along with a 5x decoding speedup.
Achieve 50% bitrate savings in ultra-low-bitrate image compression by cleverly turning image decoding into a next-frame prediction problem using video diffusion priors.
We present a novel paradigm for ultra-low-bitrate image compression (ULB-IC) that exploits the ``temporal'' evolution in generative image compression. Specifically, we define an explicit intermediate state during decoding: a compact anchor frame, which preserves the scene geometry and semantic layout while discarding high-frequency details. We then reinterpret generative decoding as a virtual temporal transition from this anchor to the final reconstructed image.To model this progression, we leverage a pretrained video diffusion model (VDM) as temporal priors: the anchor frame serves as the initial frame and the original image as the target frame, transforming the decoding process into a next-frame prediction task.In contrast to image diffusion-based ULB-IC models, our decoding proceeds from a visible, semantically faithful anchor, which improves both fidelity and realism for perceptual image compression. Extensive experiments demonstrate that our method achieves superior objective and subjective performance. On the CLIC2020 test set, our method achieves over \textbf{50\% bitrate savings} across LPIPS, DISTS, FID, and KID compared to DiffC, while also delivering a significant decoding speedup of up to $\times$5. Code will be released later.
