Search papers, labs, and topics across Lattice.
This paper introduces LA-SR, a novel framework for single image super-resolution that leverages unpaired low-resolution (LR) patches extracted from real images to enhance high-resolution (HR) reconstruction. By utilizing vision-language models to redefine the LR-HR relationship in the language space, LA-SR employs linguistic content and quality losses to ensure semantic fidelity and perceptual realism in the outputs. The results demonstrate that LA-SR significantly outperforms traditional methods reliant on synthetic data, achieving more realistic super-resolved images from real-world LR inputs.
Real-world low-resolution patches can be transformed into high-resolution images without the need for paired data, revolutionizing super-resolution techniques.
Single image super-resolution aims to reconstruct high-resolution (HR) images from low-resolution (LR) inputs. Training SR models typically requires paired HR-LR data, which is difficult to obtain in reality. As a result, most methods synthesize LR images by artificially degrading HR images with handcrafted kernels or camera ISP adjustments. However, these synthetic degradations fail to capture the complexity of real LR images, leading to poor generalization in practice. To address this, we observe that even within a single high-quality image, regions at different depths exhibit varying resolutions, where distant regions act as LR patches and closer ones as HR patches. This allows the extraction of real, degradation-induced LR patches from real images. Since these LR patches lack paired HR counterparts, we propose LA-SR (Language Assistant for SR), a novel framework for unpaired SR. The key idea of LA-SR is to redefine unpaired SR in the language space, using vision-language models to bridge the LR-HR gap. LA-SR projects images into a semantically rich space representing both content and quality, and applies two language-guided losses: linguistic content loss to preserve semantic fidelity, and linguistic quality loss to enhance perceptual realism. With this alignment, LA-SR effectively super-resolves real LR inputs, producing realistic outputs that overcome the limitations of synthetic-data-trained methods.
