Search papers, labs, and topics across Lattice.
This paper introduces a learned JPEG compression framework, J4D, specifically optimized for deep neural network (DNN) inference performance. By utilizing a differentiable soft quantizer and an information-theoretic rate estimator, the authors effectively minimize compression rates while maximizing DNN accuracy, achieving significant improvements over traditional JPEG and other DNN-optimized codecs. Experimental results reveal that J4D can enhance accuracy by up to 11.60% at the same compression rate or reduce the compression rate by 80.05% while maintaining accuracy, marking a substantial advancement in image compression for AI applications.
J4D achieves up to 11.60% higher accuracy than standard JPEG at the same compression rate, revolutionizing how we think about image compression for DNNs.
JPEG, a lossy image compression technique designed for human viewers, has maintained its dominance for decades. However, in the era of artificial intelligence (AI), a substantial portion of image data, often compressed by JPEG, is and will continue to be consumed by deep neural networks (DNNs) instead of humans, thus creating a need to optimize JPEG for DNN inference performance. To this end, we propose learned JPEG compression for DNN vision (J4D), a novel training framework for determining JPEG encoding parameters to minimize compression rate while maximizing DNN inference performance. The major challenge of solving this optimization problem lies in representing the JPEG codec and compression rate in closed form. By incorporating a differentiable soft quantizer based on a probabilistic quantization scheme, we not only obtain a differentiable proxy for the JPEG codec, but are also able to compute the entropy of the coded source analytically, which is a close estimate of the actual compression rate. Equipped with both the differentiable JPEG codec and the information-theoretic rate estimator, we are then able to solve the aforementioned optimization problem with backpropagation. After training, the learned encoding parameters will be subsequently used in actual JPEG encoding based on probabilistic quantization. Extensive experimental results across multiple datasets and DNN architectures demonstrate that J4D consistently and significantly outperforms the default JPEG and other competitive JPEG codecs optimized for DNNs. Notably, compared to the default JPEG, J4D achieves an increase in accuracy by as much as 11.60% at the same rate, or a reduction of compression rate up to 80.05% at the same accuracy. Additionally, with the help of J4D, we show the potential to design universal JPEG encoding parameters for various DNN architectures for the first time.
