Search papers, labs, and topics across Lattice.
This paper introduces a novel progressive learning approach for variable-rate deep image compression by integrating a Low-Rank Adaptation (LoRA) Rate-Adaptive Module (LoRAM) into existing methods. The proposed technique significantly reduces computational complexity and resource requirements, achieving a remarkable 99% reduction in parameter storage and 90% in dataset usage while maintaining competitive performance. Comprehensive experiments validate that this method outperforms traditional multi-model approaches, making it a promising solution for efficient image compression in high-demand applications.
Achieving 99% parameter storage savings while maintaining competitive performance in variable-rate image compression could redefine efficiency benchmarks in the field.
In the digital age, image compression is crucial for numerous applications, including web media, streaming services, high-resolution medical imaging, and connected vehicle networks, enabling efficient data storage and transmission. With the increasing demand for high-quality image communication, the need for advanced compression techniques becomes increasingly critical. Numerous Deep Image Compression (DIC) techniques have recently been introduced, showing impressive performance compared to traditional standards. However, variable-rate image compression remains an unresolved issue. Specific DIC methods deploy multiple networks to attain different compression rates, whereas others use a single model, which often results in higher computational complexity and reduced performance. This work proposes a progressive learning approach for variable-rate image compression based on the parameter-efficient fine-tuning method, the Low-Rank Adaptation (LoRA). We introduce an additional LoRA Rate-Adaptive Module (LoRAM) in DIC methods. Due to the re-parameterized merging of LoRA, our proposed method does not introduce additional computational complexity during inference. Compared to methods utilizing multiple models, comprehensive experiments demonstrate that our approach achieves competitive performance, saving 99\% in parameter storage, 90% in datasets, and 97% in training steps.