Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a training-free acceleration algorithm for autoregressive context models used in learned image compression, addressing the inefficiencies of slow serial inference. By leveraging wavefront parallelism, the method reorganizes inference into a staggered order that minimizes sequential processing while preserving autoregressive dependencies. Experimental results indicate that this approach can accelerate pre-trained models by over 13 times without compromising rate-distortion performance.
Accelerating learned image compression by over 13 times without retraining could revolutionize real-time applications in computer vision.
Autoregressive context models are foundational for learned image compression,but they suffer from slow serial inference. Existing acceleration methods such as checkerboard context require architectural changes and retraining, thus are inapplicable to pre-trained models. We propose a completely training-free inference-time acceleration algorithm inspired by wavefront parallelism in video coding standards. Our method reorganizes inference into an optimal ``staggered'' wavefront order, minimizing sequential steps while maintaining exact autoregressive dependencies. Experimental results show our approach accelerates pre-trained autoregressive models (e.g., Cheng et al.) by more than $13\times$ while preserving the original rate-distortion performance. We also demonstrate that faster decoding is possible by trading off precise context dependencies. Source code will be available at https://github.com/tokkiwa/compressai-wavefront.