Search papers, labs, and topics across Lattice.
UniRain is introduced as a unified image deraining framework designed to handle rain streak and raindrop degradation in both daytime and nighttime conditions. To improve generalization, the framework uses a retrieval augmented generation (RAG)-based dataset distillation pipeline to select high-quality training samples from public datasets. The framework also incorporates a multi-objective reweighted optimization strategy within an asymmetric mixture-of-experts (MoE) architecture to improve performance and robustness across diverse scenes.
A RAG-based dataset distillation pipeline and multi-objective reweighting unlock a single deraining model that generalizes across rain streak, raindrop, daytime, and nighttime conditions, outperforming specialized models.
Despite significant progress has been made in image deraining, we note that most existing methods are often developed for only specific types of rain degradation and fail to generalize across diverse real-world rainy scenes. How to effectively model different rain degradations within a universal framework is important for real-world image deraining. In this paper, we propose UniRain, an effective unified image deraining framework capable of restoring images degraded by rain streak and raindrop under both daytime and nighttime conditions. To better enhance unified model generalization, we construct an intelligent retrieval augmented generation (RAG)-based dataset distillation pipeline that selects high-quality training samples from all public deraining datasets for better mixed training. Furthermore, we incorporate a simple yet effective multi-objective reweighted optimization strategy into the asymmetric mixture-of-experts (MoE) architecture to facilitate consistent performance and improve robustness across diverse scenes. Extensive experiments show that our framework performs favorably against the state-of-the-art models on our proposed benchmarks and multiple public datasets.
