Search papers, labs, and topics across Lattice.
Tsinghua AIB-Ins)Hangzhou High-Tech Zone (BinjiangInstitute of Blockchain and DataZJUMar 17, 2026arXiv:2603.16362This paper introduces $D^3$-RSMDE, a novel framework for real-time, high-fidelity monocular depth estimation from remote sensing imagery. It combines a ViT-based module for fast initial depth map construction with a diffusion-based refinement strategy using a lightweight U-Net operating in a compact latent space. The method achieves a 40x speedup compared to existing diffusion models while improving perceptual quality by 11.85% in LPIPS compared to state-of-the-art models like Marigold.
Achieve diffusion-level perceptual quality in monocular depth estimation at 40x the speed, by replacing the slow initial diffusion steps with a fast ViT-based depth map and refining in a compact latent space.
Real-time, high-fidelity monocular depth estimation from remote sensing imagery is crucial for numerous applications, yet existing methods face a stark trade-off between accuracy and efficiency. Although using Vision Transformer (ViT) backbones for dense prediction is fast, they often exhibit poor perceptual quality. Conversely, diffusion models offer high fidelity but at a prohibitive computational cost. To overcome these limitations, we propose Depth Detail Diffusion for Remote Sensing Monocular Depth Estimation ($D^3$-RSMDE), an efficient framework designed to achieve an optimal balance between speed and quality. Our framework first leverages a ViT-based module to rapidly generate a high-quality preliminary depth map construction, which serves as a structural prior, effectively replacing the time-consuming initial structure generation stage of diffusion models. Based on this prior, we propose a Progressive Linear Blending Refinement (PLBR) strategy, which uses a lightweight U-Net to refine the details in only a few iterations. The entire refinement step operates efficiently in a compact latent space supported by a Variational Autoencoder (VAE). Extensive experiments demonstrate that $D^3$-RSMDE achieves a notable 11.85% reduction in the Learned Perceptual Image Patch Similarity (LPIPS) perceptual metric over leading models like Marigold, while also achieving over a 40x speedup in inference and maintaining VRAM usage comparable to lightweight ViT models.
