Search papers, labs, and topics across Lattice.
This paper introduces ZipDepth, a lightweight monocular depth estimation network that utilizes a reparameterizable encoder-decoder architecture combined with knowledge distillation from a foundation model trained on a diverse multi-domain dataset. The approach addresses the computational limitations of existing models, making robust zero-shot depth estimation feasible on mobile and embedded platforms. Key results show that ZipDepth, with only 6.1M parameters, achieves superior zero-shot accuracy and deployment efficiency compared to larger models, marking a significant advancement in the field.
ZipDepth achieves real-time monocular depth estimation on resource-constrained devices while rivaling the accuracy of much larger models.
Monocular depth estimation has seen remarkable progress through foundation models achieving robust zero-shot generalization, yet their computational demands place them far beyond the reach of embedded and mobile platforms. Lightweight alternatives exist, but have been developed almost exclusively within single-domain, self-supervised paradigms, failing silently under domain shift. We present ZipDepth, a compact monocular depth network that bridges this gap by combining an efficient reparameterizable encoder-decoder with large-scale knowledge distillation from a foundation model over a large multi-domain training set. Comprising just 6.1M parameters, ZipDepth runs at real-time rates from server GPUs to power-constrained devices, achieving the best trade-off between zero-shot accuracy and deployment efficiency among lightweight models across five benchmarks, taking a significant step towards the accuracy of foundation models with 50x more parameters.
