Search papers, labs, and topics across Lattice.
This paper introduces LiteKD-Net, a lightweight knowledge-distilled network designed for mobile image denoising, addressing the dual challenges of achieving high restoration quality while minimizing computational costs. The authors employ a physics-guided noise simulation pipeline to generate paired training data, and adapt the Real-ESRGAN architecture to create a lightweight Student model using depthwise separable convolutions. Experimental results demonstrate that LiteKD-Net significantly reduces runtime and enhances inference rates, outperforming existing models like SwinIR across all metrics, thus offering an effective balance between quality and efficiency.
LiteKD-Net achieves superior image denoising performance on mobile devices while slashing runtime costs, setting a new standard for efficiency in the field.
Mobile image denoising requires both good restoration quality and low computational cost. In addition, it's annoying to collect large-scale LQ-GT clean pairs. As a result, we propose LiteKD-Net, a lightweight knowledge-distilled network for mobile image denoising. First, a physics-guided noise simulation pipeline generates paired training data by adding pixel crosstalk compared with pipelines applied to cameras. Next, we adapt the Real-ESRGAN to identity-resolution denoising and construct a lightweight Student using Lite-RRDB blocks based on depthwise separable convolutions. Third, feature-level knowledge distillation is applied to transfer the Teacher's restoration capability to the Student without introducing additional inference cost. Experiments on real-world datasets show that our model reaches great reduction in runtime and increase in the inference rate with good restoration quality. Our model also reaches the best in all metrics compared with SwinIR. These results indicate that LiteKD-Net provides a great trade-off between restoration quality and computational efficiency.
