Search papers, labs, and topics across Lattice.
This paper introduces Wat3R, a cross-domain semi-supervised learning framework that adapts 3D reconstruction models from air to underwater environments without requiring annotated underwater data. By employing a teacher-student architecture and a novel cross-view consistency loss, the method effectively utilizes abundant unlabeled underwater video footage to learn robust geometry representations. Experimental results show that Wat3R significantly surpasses existing state-of-the-art techniques in underwater multi-view depth estimation and point cloud reconstruction, while also contributing a new dataset, Water3D, for evaluating geometric tasks in diverse underwater scenarios.
Wat3R achieves superior underwater 3D geometry estimation without any annotated data, leveraging unlabeled footage to overcome the challenges of light attenuation and scattering.
Estimating 3D geometry in underwater environments presents unique challenges due to light attenuation, scattering, and the absence of large-scale, high-quality 3D annotations. Pioneering methods rely on massive dense annotations that are impractical in underwater settings. In this paper, we propose Wat3R, a cross-domain semi-supervised learning framework designed to adapt feed-forward 3D reconstruction models from air to underwater scenes. Uniquely, our method eliminates the need for any annotated underwater data following a teacher-student architecture, that learns robust geometry representations merely on abundant unlabeled real underwater video footage. We also design a cross-view consistency loss that leverages geometric cues from other views to compensate for the information degradation in the current view caused by water attenuation and scattering. Furthermore, considering the lack of comprehensive evaluation benchmarks, we construct Water3D, a diverse dataset covering various water bodies and underwater scenarios, designed for geometric task evaluation. Experimental results demonstrate that Wat3R outperforms current state-of-the-art methods in underwater multi-view depth estimation and point cloud reconstruction. The dataset and code are available at https://github.com/LSXI7/Wat3R .
