Search papers, labs, and topics across Lattice.
This paper introduces MGN-AIR, a novel pixel-level restoration framework that enhances all-in-one image restoration by providing fine-grained control over the restoration process. Unlike previous methods that apply a uniform strategy across the entire image, MGN-AIR utilizes pixel-level visual prompts alongside global and local degradation cues to tailor the restoration for distinct regions suffering from varying types and levels of degradation. Experimental results show that MGN-AIR significantly outperforms existing approaches across multiple benchmarks, including denoising, deraining, and low-light enhancement tasks.
Pixel-level restoration can dramatically improve image quality by addressing specific degradation types and severities, outperforming traditional uniform methods.
All-in-one image restoration is a unified low-level vision task that aims to effectively recover high-quality images from inputs degraded by various types and levels of corruption using a single model. Recent works have achieved remarkable progress by learning degradation-adaptive prompts or network architectures. However, these methods typically apply a uniform restoration strategy across the entire image, neglecting the fact that different regions may suffer from distinct degradation types and varying degrees of severity. In contrast, we propose to perform restoration at the pixel level, thereby enabling more fine-grained and precise control over the restoration process. Specifically, we present MGN-AIR, a novel pixel-level restoration framework for all-in-one image restoration. Our approach first learns to estimate a pixel-level visual prompt. Then, it leverages both textual and visual prompts to provide global and local degradation cues, guiding the model on where to look and how to restore at each pixel. We conduct extensive experiments on multiple all-in-one image restoration benchmarks, covering a wide range of tasks including denoising, deraining, deblurring, dehazing, desnowing, and low-light enhancement. Experimental results demonstrate that our proposed method consistently and significantly outperforms existing approaches.
