Search papers, labs, and topics across Lattice.
This paper introduces GeoStereo, a unified framework for stereo geometry estimation that integrates disparity and surface normal predictions using diffusion priors. By coupling a feed-forward stereo matching pipeline with a diffusion-based normal estimation branch, the framework effectively enhances disparity estimation in challenging conditions while maintaining accurate normal predictions. Extensive evaluations demonstrate that GeoStereo achieves state-of-the-art performance in zero-shot settings across multiple benchmarks, particularly excelling in complex environments like low-light and reflective surfaces.
GeoStereo achieves Rank-1 disparity estimation under zero-shot conditions, outperforming existing methods in challenging 3D vision scenarios.
Stereo matching and surface normal estimation are fundamental tasks in 3D vision. However, existing feed-forward stereo methods still struggle to produce reliable predictions in challenging regions, mainly due to the lack of strong geometric priors. In this paper, we propose $\textbf{GeoStereo}$, a unified stereo geometry estimation framework that leverages powerful diffusion priors to jointly predict disparity and surface normals. Specifically, GeoStereo couples a feed-forward stereo matching pipeline with a diffusion-based normal estimation branch. To enable effective interaction between the two tasks, we introduce a disparity to normal initialization strategy and construct a warp to left-view condition for the diffusion process. This coupled design allows the diffusion branch to provide strong structural priors that enhance disparity estimation in ill-posed regions, while the feed-forward branch offers reliable geometric guidance for accurate normal prediction. Extensive experiments show that GeoStereo performs reliably in challenging scenarios, including low-light environments, highly reflective surfaces, and transparent objects. Under zero-shot settings, it achieves Rank-1 disparity estimation on multiple benchmarks, including KITTI and NYUv2, and delivers the best normal estimation accuracy on many real indoor benchmarks, such as iBims-1 and ScanNet. Project page: https://qz-wei.github.io/GeoStereo.github.io/
