Search papers, labs, and topics across Lattice.
This paper introduces Prompt-Driven Noise Generation (PNG), a diffusion-based framework for synthesizing realistic sRGB noise without relying on camera metadata. PNG learns high-dimensional prompt features that capture the characteristics of real-world input noise, enabling the generation of diverse noisy images consistent with the input noise distribution. Experiments demonstrate that PNG effectively produces realistic noisy images, which can be used to improve real-world image denoising performance on benchmark datasets.
Ditch the camera metadata: this diffusion model learns to generate realistic sRGB noise directly from noisy image prompts, boosting denoising performance in real-world scenarios.
Denoising in the sRGB image space is challenging due to noise variability. Although end-to-end methods perform well, their effectiveness in real-world scenarios is limited by the scarcity of real noisy-clean image pairs, which are expensive and difficult to collect. To address this limitation, several generative methods have been developed to synthesize realistic noisy images from limited data. These generative approaches often rely on camera metadata during both training and testing to synthesize real-world noise. However, the lack of metadata or inconsistencies between devices restricts their usability. Therefore, we propose a novel framework called Prompt-Driven Noise Generation (PNG). This model is capable of acquiring high-dimensional prompt features that capture the characteristics of real-world input noise and creating a variety of realistic noisy images consistent with the distribution of the input noise. By eliminating the dependency on explicit camera metadata, our approach significantly enhances the generalizability and applicability of noise synthesis. Comprehensive experiments reveal that our model effectively produces realistic noisy images and show the successful application of these generated images in removing real-world noise across various benchmark datasets.
