Search papers, labs, and topics across Lattice.
GloSplat introduces a joint pose-appearance optimization framework for 3D Gaussian Splatting (3DGS) that maintains explicit SfM feature tracks as optimizable parameters alongside Gaussian primitives. By incorporating a reprojection loss on these feature tracks in addition to photometric supervision, GloSplat prevents pose drift and enables fine-grained refinement during training. The framework includes a COLMAP-free variant (GloSplat-F) using retrieval-based pair selection and an exhaustive matching variant (GloSplat-A), both demonstrating state-of-the-art performance in 3D reconstruction.
By explicitly optimizing feature tracks alongside photometric consistency, GloSplat achieves faster and more accurate 3D reconstruction, surpassing both COLMAP-free and COLMAP-based baselines.
Feature extraction, matching, structure from motion (SfM), and novel view synthesis (NVS) have traditionally been treated as separate problems with independent optimization objectives. We present GloSplat, a framework that performs \emph{joint pose-appearance optimization} during 3D Gaussian Splatting training. Unlike prior joint optimization methods (BARF, NeRF--, 3RGS) that rely purely on photometric gradients for pose refinement, GloSplat preserves \emph{explicit SfM feature tracks} as first-class entities throughout training: track 3D points are maintained as separate optimizable parameters from Gaussian primitives, providing persistent geometric anchors via a reprojection loss that operates alongside photometric supervision. This architectural choice prevents early-stage pose drift while enabling fine-grained refinement -- a capability absent in photometric-only approaches. We introduce two pipeline variants: (1) \textbf{GloSplat-F}, a COLMAP-free variant using retrieval-based pair selection for efficient reconstruction, and (2) \textbf{GloSplat-A}, an exhaustive matching variant for maximum quality. Both employ global SfM initialization followed by joint photometric-geometric optimization during 3DGS training. Experiments demonstrate that GloSplat-F achieves state-of-the-art among COLMAP-free methods while GloSplat-A surpasses all COLMAP-based baselines.
