Search papers, labs, and topics across Lattice.
QuantSR+ is introduced as a unified framework to improve the performance of ultra-low precision (2-4 bits) image super-resolution (SR) models by addressing the performance drop caused by diminished representational capacity. The framework incorporates Redistribution-driven Bit Determination (RBD) to reshape quantization distributions, Quantized Slimmable Architecture (QSA) to prune less critical blocks, and Slimming-guided Function-localized Distillation (SFD) for feature alignment and faster convergence. Experiments demonstrate state-of-the-art performance and significant efficiency gains compared to existing quantized SR methods, improving PSNR by 0.29 dB over the 2-bit SOTA baseline for SwinIR-S on Urban100 (x4).
Pushing super-resolution models to the extreme of 2-bit quantization doesn't have to mean sacrificing accuracy, thanks to QuantSR+'s clever combination of quantization-aware operators, architecture, and training.
Low-bit quantization is widely used to compress super-resolution (SR) models and reduce storage and computation costs for deployment on resource-limited devices. However, when SR models are pushed to ultra-low precision (2-4 bits), performance can drop sharply due to diminished representational capacity and the detail-sensitive nature of SR. To address these issues, we propose QuantSR+, a unified framework that improves quantization operators, network design, and training optimization, achieving better trade-offs between accuracy and efficiency than prior low-bit SR methods. QuantSR+ mainly relies on three technical contributions: (1) Redistribution-driven Bit Determination (RBD), which reshapes quantization distributions in both forward and backward passes to preserve representation fidelity; (2) Quantized Slimmable Architecture (QSA), which begins with an over-parameterized model and progressively prunes less critical blocks to meet efficiency budgets while pushing the accuracy performance; and (3) Slimming-guided Function-localized Distillation (SFD), which enforces block-aware feature alignment via a direct loss and a progressive, function-local training schedule to capture quantization effects better and speed up convergence. Extensive experiments show that QuantSR+ achieves state-of-the-art performance against both specialized quantized SR methods and generic quantization approaches. For SwinIR-S on Urban100 (x4), it improves PSNR by 0.29 dB over the 2-bit SOTA baseline. Meanwhile, it delivers strong efficiency gains at 2-bit, reducing operations by up to 87.9% and storage by 89.4%. QuantSR+ is effective for both convolutional and transformer-based SR models, indicating broad applicability.
