Search papers, labs, and topics across Lattice.
This paper introduces SurGe, a novel approach to improving local surface geometry in point maps for 3D reconstruction. By employing a point gradient matching loss and a Neighborhood Attention Decoder, the method enhances the accuracy of local surface orientation, which is often overlooked in traditional evaluation metrics. The results demonstrate that SurGe achieves superior performance across multiple zero-shot monocular geometry benchmarks, particularly in local and global evaluations of point maps.
SurGe reveals that enhancing local surface geometry can significantly elevate the performance of 3D reconstruction models, challenging the status quo of existing evaluation metrics.
Recent feedforward 3D reconstruction methods predict point maps and estimate global 3D geometry remarkably well. However, their predictions still exhibit inaccurate local surface geometry, which is clearly visible qualitatively but only weakly reflected in common metrics. To make these errors more explicit in evaluation, we introduce a point map normal metric that evaluates the local surface orientation induced by neighboring 3D predictions. To reduce these errors, we propose two complementary components: a point gradient matching loss that supervises depth-normalized 3D finite differences, and a Neighborhood Attention Decoder (NAD) that progressively upsamples features and uses Neighborhood Attention for local feature mixing. Across eight zero-shot monocular geometry benchmarks, our model, SurGe, achieves the best average rank for global point map AbsRel and consistently improves local point map and point map normal evaluations.
