Search papers, labs, and topics across Lattice.
This paper introduces IQ-LUT, a method to reduce the storage footprint of LUT-based image super-resolution by integrating interpolation, quantization, and residual learning within an Efficient Cascaded Network (ECNN). By interpolating and quantizing the ECNN's input space, the method drastically reduces the LUT index space, while residual learning minimizes the dependence on LUT bit-depth. Knowledge distillation guides a non-uniform quantization process, optimizing quantization levels to further reduce storage and compensate for quantization loss, achieving up to 50x storage reduction compared to ECNN while improving super-resolution quality.
Achieve state-of-the-art image super-resolution with a 50x smaller lookup table, unlocking deployment on resource-constrained devices.
Lookup table (LUT) methods demonstrate considerable potential in accelerating image super-resolution inference. However, pursuing higher image quality through larger receptive fields and bit-depth triggers exponential growth in the LUT's index space, creating a storage bottleneck that limits deployment on resource-constrained devices. We introduce IQ-LUT, which achieves a reduction in LUT size while simultaneously enhancing super-resolution quality. First, we integrate interpolation and quantization into the single-input, multiple-output ECNN, which dramatically reduces the index space and thereby the overall LUT size. Second, the integration of residual learning mitigates the dependence on LUT bit-depth, which facilitates training stability and prioritizes the reconstruction of fine-grained details for superior visual quality. Finally, guided by knowledge distillation, our non-uniform quantization process optimizes the quantization levels, thereby reducing storage while also compensating for quantization loss. Extensive benchmarking demonstrates our approach substantially reduces storage costs (by up to 50x compared to ECNN) while achieving superior super-resolution quality.
