Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces DerainSplat, a novel feed-forward framework designed to reconstruct clean 3D scenes from sparse rainy views, addressing the limitations of existing methods that falter under adverse weather conditions. By creating a large-scale multi-view derain dataset and employing a weather net to predict weather factors, the approach enhances cross-view cost-volume matching and depth-aligned appearance fusion. Experimental results demonstrate that DerainSplat significantly outperforms current state-of-the-art methods across multiple datasets, showcasing its robustness and generalization capabilities in real-world scenarios.
DerainSplat achieves superior 3D scene reconstruction from sparse rainy views, outperforming traditional methods that struggle with weather-induced distortions.
Although image deraining has advanced substantially, existing methods mainly focus on 2D image restoration. As spatial intelligence applications such as embodied AI and autonomous driving continue to emerge, reconstructing clean 3D scenes from sparse rainy views in a feed-forward manner becomes increasingly important. Existing feed-forward 3D Gaussian Splatting (3DGS) methods often assume clean inputs and collapse under rainy conditions. To this end, we present \textbf{\textit{DerainSplat}}, a feed-forward framework that reconstructs clean 3D scenes from only a few rainy views. To support this task, we build a large-scale multi-view derain dataset through a four-stage synthesis pipeline that sequentially models overcast illumination, depth-dependent haze, rain streaks, and lens raindrops, producing privileged weather factors. We introduce a weather net that predicts the weather factors from rainy context and yields two support maps. Scene support modulates cross-view cost-volume matching, while radiance support drives depth-aligned appearance fusion to fill corrupted pixels. The derived geometry evidence further attenuates Gaussian opacity to reduce spurious structures. A rainy cycle consistency re-renders clean views using the predicted factors and aligns them with rainy inputs. Extensive experiments show that \textbf{\textit{DerainSplat}} outperforms existing methods on various datasets, including RealEstate10K, ACID, Mip-NeRF360, and real-world rainy scenes, with strong cross-dataset generalization.