Search papers, labs, and topics across Lattice.
The paper introduces StereoAdapter-2, a novel framework for underwater stereo depth estimation that addresses domain shifts caused by underwater conditions. It replaces the ConvGRU updater in previous methods with a ConvSS2D operator, which utilizes selective state space models and a four-directional scanning strategy to efficiently capture long-range spatial dependencies. The authors also construct a large-scale synthetic underwater stereo dataset, UW-StereoDepth-80K, and demonstrate state-of-the-art zero-shot performance on underwater benchmarks, achieving significant improvements over existing methods.
By swapping out ConvGRUs for a novel ConvSS2D operator, StereoAdapter-2 achieves state-of-the-art zero-shot underwater stereo depth estimation with a single update step.
Stereo depth estimation is fundamental to underwater robotic perception, yet suffers from severe domain shifts caused by wavelength-dependent light attenuation, scattering, and refraction. Recent approaches leverage monocular foundation models with GRU-based iterative refinement for underwater adaptation; however, the sequential gating and local convolutional kernels in GRUs necessitate multiple iterations for long-range disparity propagation, limiting performance in large-disparity and textureless underwater regions. In this paper, we propose StereoAdapter-2, which replaces the conventional ConvGRU updater with a novel ConvSS2D operator based on selective state space models. The proposed operator employs a four-directional scanning strategy that naturally aligns with epipolar geometry while capturing vertical structural consistency, enabling efficient long-range spatial propagation within a single update step at linear computational complexity. Furthermore, we construct UW-StereoDepth-80K, a large-scale synthetic underwater stereo dataset featuring diverse baselines, attenuation coefficients, and scattering parameters through a two-stage generative pipeline combining semantic-aware style transfer and geometry-consistent novel view synthesis. Combined with dynamic LoRA adaptation inherited from StereoAdapter, our framework achieves state-of-the-art zero-shot performance on underwater benchmarks with 17% improvement on TartanAir-UW and 7.2% improvment on SQUID, with real-world validation on the BlueROV2 platform demonstrates the robustness of our approach. Code: https://github.com/AIGeeksGroup/StereoAdapter-2. Website: https://aigeeksgroup.github.io/StereoAdapter-2.
Tsinghua AI