Search papers, labs, and topics across Lattice.
The paper introduces DrivingDepth, a novel approach for depth estimation in autonomous driving that addresses the geometry-scale conflict between dense foundation models and sparse LiDAR data. By utilizing sparse LiDAR as geometric prompts, DrivingDepth applies a pixel-wise scale correction to align the foundation model's coherent geometry with metric coordinates, avoiding the need to regenerate depth from scratch. The method achieves state-of-the-art performance on the nuScenes dataset, significantly improving both metric accuracy and geometric consistency compared to existing methods.
DrivingDepth achieves state-of-the-art depth estimation by leveraging sparse LiDAR to fine-tune pixel-wise scale without sacrificing geometric coherence.
Dense depth estimation for autonomous driving faces a geometry-scale conflict: depth foundation models deliver pixel-aligned dense visual geometry without reliable metric scale, while projected LiDAR provides metric anchors that are sparse, noisy, and misaligned with image structures. Existing sparse-prompted methods incorporate LiDAR by regenerating depth from scratch, overriding the foundation model's coherent geometry and producing structural artifacts on visually continuous surfaces. Our key insight is that foundation models already capture geometrically coherent relative depth; no additional surface structure learning is required-only a per-pixel scale factor mapping relative geometry to metric coordinates. Based on this, we propose DrivingDepth, which treats sparse LiDAR as geometric prompts that locally calibrate a frozen foundation prior through residual pixel-wise scale correction, preserving dense visual geometry by construction. On nuScenes with 4-frame surround-view input, DrivingDepth achieves an AbsRel of 11.19 and an EdgeCR of 5.741, outperforming MapAnything (11.99/1.914) by simultaneously delivering SOTA metric accuracy and geometric consistency.
