Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
ZeD-MAP leverages zero-shot diffusion models for fast, per-image depth prediction from UAV imagery but addresses their inherent metric inconsistency by integrating incremental cluster-based bundle adjustment (BA). Streamed frames are grouped into overlapping clusters, and BA generates metrically consistent poses and sparse 3D tie-points. These tie-points are then reprojected into frames to guide diffusion-based depth estimation, resulting in sub-meter accuracy with real-time performance.
Zero-shot diffusion models can achieve near-photogrammetric accuracy for real-time UAV mapping when guided by bundle adjustment, sidestepping the need for task-specific retraining or rigid capture geometries.
Real-time depth reconstruction from ultra-high-resolution UAV imagery is essential for time-critical geospatial tasks such as disaster response, yet remains challenging due to wide-baseline parallax, large image sizes, low-texture or specular surfaces, occlusions, and strict computational constraints. Recent zero-shot diffusion models offer fast per-image dense predictions without task-specific retraining, and require fewer labelled datasets than transformer-based predictors while avoiding the rigid capture geometry requirement of classical multi-view stereo. However, their probabilistic inference prevents reliable metric accuracy and temporal consistency across sequential frames and overlapping tiles. We present ZeD-MAP, a cluster-level framework that converts a test-time diffusion depth model into a metrically consistent, SLAM-like mapping pipeline by integrating incremental cluster-based bundle adjustment (BA). Streamed UAV frames are grouped into overlapping clusters; periodic BA produces metrically consistent poses and sparse 3D tie-points, which are reprojected into selected frames and used as metric guidance for diffusion-based depth estimation. Validation on ground-marker flights captured at approximately 50 m altitude (GSD is approximately 0.85 cm/px, corresponding to 2,650 square meters ground coverage per frame) with the DLR Modular Aerial Camera System (MACS) shows that our method achieves sub-meter accuracy, with approximately 0.87 m error in the horizontal (XY) plane and 0.12 m in the vertical (Z) direction, while maintaining per-image runtimes between 1.47 and 4.91 seconds. Results are subject to minor noise from manual point-cloud annotation. These findings show that BA-based metric guidance provides consistency comparable to classical photogrammetric methods while significantly accelerating processing, enabling real-time 3D map generation.