Search papers, labs, and topics across Lattice.
This paper introduces the unified removal of raindrops and reflections (UR$^3$) task, addressing the practical problem of composite image degradation caused by raindrops and reflections. To facilitate research in this area, the authors construct a real-shot dataset called RDRF, providing a new benchmark with high-quality image pairs. They then propose DiffUR$^3$, a novel diffusion-based framework that leverages generative priors to effectively remove both raindrops and reflections, achieving state-of-the-art performance.
Real-world images plagued by both raindrops and reflections finally get a dedicated benchmark dataset (RDRF) and a diffusion-based model (DiffUR$^3$) that actually works.
When capturing images through glass surfaces or windshields on rainy days, raindrops and reflections frequently co-occur to significantly reduce the visibility of captured images. This practical problem lacks attention and needs to be resolved urgently. Prior de-raindrop, de-reflection, and all-in-one models have failed to address this composite degradation. To this end, we first formally define the unified removal of raindrops and reflections (UR$^3$) task for the first time and construct a real-shot dataset, namely RainDrop and ReFlection (RDRF), which provides a new benchmark with substantial, high-quality, diverse image pairs. Then, we propose a novel diffusion-based framework (i.e., DiffUR$^3$) with several target designs to address this challenging task. By leveraging the powerful generative prior, DiffUR$^3$ successfully removes both types of degradations. Extensive experiments demonstrate that our method achieves state-of-the-art performance on our benchmark and on challenging in-the-wild images. The RDRF dataset and the codes will be made public upon acceptance.
