Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper addresses the "scale-collapse" issue in monocular geometry estimation, where distant landmarks are metrically underestimated due to limitations in existing training datasets. By curating a new dataset called MetricScenes, which incorporates diverse real-world imagery and improved depth estimation techniques, the authors enhance the performance of the MoGe-2 model. The results show that fine-tuning on this dataset significantly reduces scale-collapse and improves metric accuracy in open-domain scenes, outperforming existing benchmarks.
Fine-tuning on a new, diverse dataset allows models to overcome the scale-collapse phenomenon, achieving unprecedented accuracy in monocular geometry estimation.
Metric scale monocular geometry estimation has seen significant progress through large-scale data aggregation, yet current foundation models suffer from a persistent ''scale-collapse'' phenomenon: distant landmarks and vast landscapes are metrically underestimated. We hypothesize that this performance gap stems from a training data bottleneck, where existing metric-scale datasets are hardware-constrained to homogenous vehicle-captured LiDAR or short-range indoor scans, or consist of synthetic data that lacks the semantic complexity of the physical world. To bridge this gap, we curate a new metrically-grounded, in-the-wild dataset that we call MetricScenes, gathered from a variety of sources including Internet photo collections and stereo imagery. We estimate camera poses and initial depth maps for each scene using off-the-shelf methods, and recover absolute scale from geo-tagged metadata as well as known stereo camera baselines. We also improve the quality of depth maps derived from MetricScenes via a new two-stage Poisson completion method. Fine-tuning MoGe-2 on our dataset significantly mitigates scale-collapse and achieves superior metric accuracy in unconstrained, open-domain scenes while maintaining state-of-the-art performance on standard benchmarks.