Search papers, labs, and topics across Lattice.
This paper introduces BenthicFlow, a novel framework that utilizes a single conditional flow-matching model to generate aligned textures and depth maps for underwater environments, addressing the limitations of existing methods that rely on separate models for scene assembly. By employing a MultiDiffusion-inspired sampling procedure, BenthicFlow creates spatially extensible RGBD mosaics without the need for post hoc stitching, allowing for coherent large-scale 3D scene generation. Experimental results show that BenthicFlow effectively preserves site-specific characteristics while producing 3D environments that align closely with target distributions across diverse underwater survey sites.
BenthicFlow generates coherent, large-scale 3D underwater environments in a unified framework, eliminating the need for separate scene stitching.
Computer vision applications for 3D scene understanding in underwater environments remain challenging due to the lack of high-quality 3D data and the inability of surface-trained models to generalize to underwater scenes. To address this challenge, an emerging trend is to employ generative models to close the data domain gap. However, existing methods assemble large scenes by stitching independently generated tiles post hoc with separately trained models, while demonstrating heterogeneous landscapes only within individual survey sites. We introduce BenthicFlow, a unified framework based on a single conditional flow-matching model that jointly generates aligned textures and depth maps. A MultiDiffusion-inspired sampling procedure reconciles overlapping windows throughout the generative trajectory, enabling spatially extensible RGBD mosaics without a separate stitching model. The generated mosaics are subsequently lifted into explicit 3D benthic environments using surface-aligned Gaussian surfels. Experiments across geographically distinct survey sites demonstrate that BenthicFlow preserves site-specific appearance while generating coherent, large-scale 3D scenes that closely match the target distributions. Code and trained models are available at https://github.com/jacomof/BenthicFlow.