Search papers, labs, and topics across Lattice.
This paper introduces FASR++, a novel super-resolution algorithm based on diffusion models that enhances facial images captured in challenging surveillance conditions by aggregating features from multiple low-quality images. The approach effectively minimizes identity distortions while improving image quality, which is crucial for reliable face recognition. Experimental results on standard datasets demonstrate that FASR++ achieves state-of-the-art performance in both face recognition and image quality metrics, significantly advancing the capabilities of existing algorithms in this domain.
FASR++ transforms low-quality surveillance images into high-resolution facial representations, achieving state-of-the-art recognition accuracy without compromising identity integrity.
Images acquired in surveillance environments often suffer from conditions such as low resolution, variations in pose, irregular illumination, and occlusions. Due to the low quality of these images, face recognition algorithms often struggle. This major limitation can be addressed by employing super-resolution techniques that enhance the details of the image. However, due to the high degree of difficulty of the problem, most super-resolution algorithms tend to cause distortions in the image and in the individual's identity. Thus, additional information must be incorporated into the processing to improve recognition robustness. In this regard, surveillance cameras can capture multiple images, even at low quality, and the data extracted from these images, such as consecutive video frames, can significantly enhance both super-resolution and facial recognition. In this work, we introduce FASR++, a diffusion-model-based super-resolution algorithm. It leverages a reference low-resolution image and features extracted from multiple auxiliary low-quality images to generate a super-resolved output, minimizing distortions in the individual's identity. Our approach recovers facial features without explicitly providing soft attributes or computing a function gradient to guide the reconstruction process. FASR++ generates high-quality images that can considerably improve performance in face recognition tasks when used as a pre-processing step. We validate our approach on two standard face recognition datasets and attain state-of-the-art results for verification, face recognition, and image quality metrics such as PSNR, SSIM, and LPIPS.
