Search papers, labs, and topics across Lattice.
This paper introduces DepthMaster, a unified framework for monocular depth estimation that effectively handles both narrow field-of-view perspectives and 360-degree panoramic images. By decomposing panoramic images into overlapping perspective patches and employing a novel Correspondence Consistency Loss (CCL), the method overcomes the geometric discrepancies between different camera types and leverages extensive perspective datasets to enhance metric depth estimation. The results demonstrate that DepthMaster achieves state-of-the-art zero-shot performance across 13 diverse datasets, surpassing both universal and specialist models in depth estimation tasks.
DepthMaster achieves state-of-the-art zero-shot depth estimation across diverse datasets by unifying perspective and panoramic inputs into a single framework.
While monocular depth estimation has achieved significant progress, achieving generalized metric depth estimation for both narrow field-of-view (FoV) perspectives and $360^\circ$ panoramas remains an unsolved challenge. Existing methods are often tailored to specific camera types and struggle to produce accurate metric depth that generalizes across diverse settings. This limitation stems from two key challenges: the inherent geometric discrepancy between perspective and panoramic cameras, and the scarcity of panoramic training data with metric annotations. In this work, we introduce DepthMaster, a unified metric depth estimation framework. Rather than employing specialized networks to learn spherical distortions, we reformulate the problem by decomposing panoramic images into overlapping perspective patches. Crucially, distinct from prior projection-based methods that rely on ad-hoc architectural modifications to handle boundaries, we introduce a novel Correspondence Consistency Loss (CCL) and inject virtual projection cameras as geometric priors, allowing us to seamlessly stitch the patches while avoiding specialized operators and keeping the backbone largely compatible with standard Transformer designs. This strategy also resolves the geometric differences by unifying all inputs into a canonical perspective representation, and effectively circumvents data scarcity by directly unlocking powerful metric priors from vast perspective datasets. Trained on a mixed dataset that contains only one panorama dataset, DepthMaster achieves state-of-the-art zero-shot performance on 13 diverse datasets, outperforming not only universal methods but also leading specialist models in both perspective and panoramic domains.
