Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a reference-based approach to face super-resolution that leverages higher resolution images to enhance detail in low-resolution facial images. By employing a spatial transformer for alignment, the method demonstrates improved stability over traditional deformable convolutions, while an innovative aggregation function intelligently utilizes reference information. The proposed model achieves state-of-the-art performance across multiple datasets despite its relatively smaller size, highlighting its efficiency and effectiveness in face super-resolution tasks.
A reference-based face super-resolution method outperforms larger models by effectively utilizing higher resolution images for enhanced detail and stability.
Face super-resolution is the task of increasing the resolution of an image containing a face thereby adding finer detail. It is a ubiquitous task in many computer vision applications and quite often the user isn't even aware that it is being performed. However, doing it with high fidelity is challenging as it is an ill-posed problem. In this paper we present a reference-based solution for face super-resolution that uses higher resolution reference images to aid in the task. We show an alignment module based on the spatial transformer that is considerably more stable than the popular deformable convolutions. We also show an aggregation function that can take good quality information from the reference images when available or suppress the function when such information is unavailable. Finally, we show that our relatively smaller model can achieve state of the art results on multiple datasets. The source code is available at https://github.com/varun-jois/FSRST.