Search papers, labs, and topics across Lattice.
This paper introduces the Gravity Grounded Geometry Transformer (G3T) for predicting pointmaps in gravity-aligned coordinate frames, exploiting structural priors in real-world scenes. By predicting upright pointmaps and camera-to-gravity poses, G3T reduces rotational degrees of freedom compared to camera-centric approaches. The authors demonstrate that G3T, when integrated into an incremental 3D reconstruction pipeline (G3T-Long), achieves significantly improved reconstruction accuracy.
Gravity-aligned coordinate frames are the surprisingly simple trick that unlocks significantly improved 3D reconstruction accuracy.
Modern feed-forward 3D reconstruction methods like VGGT predict pixel-aligned pointmaps in camera-centric coordinate frames. However, this choice of coordinate frame is not always optimal. We propose instead to predict pointmaps in upright, gravity-aligned frames that exploit strong structural cues present in many real-world scenes. Unlike camera-centric frames, gravity-aligned frames share a common vertical axis across viewpoints, reducing the rotational degrees of freedom needed to relate pointmaps to one another. To this end, we introduce the Gravity Grounded Geometry Transformer (G3T), fine-tuned from existing models on gravity-aligned 3D data. G3T produces highly accurate gravity-aware predictions, including upright pointmaps and camera-to-gravity poses. We further introduce G3T-Long, a submap-based incremental 3D reconstruction pipeline that leverages the reduced rotational degrees of freedom afforded by upright frames to achieve significantly improved reconstruction accuracy.
