Search papers, labs, and topics across Lattice.
This paper introduces GS-CPE, a novel framework for 6-degree-of-freedom camera pose estimation that integrates geometry-based coarse pose estimation with 3D Gaussian Splatting for refined accuracy. The method employs a retrieval-guided approach to initially estimate pose, followed by a multi-scale optimization process that minimizes a visibility-aware masked RGB warping objective. Extensive evaluations across multiple datasets, including 7Scenes and Cambridge Landmarks, reveal that GS-CPE achieves superior performance in both accuracy and generalization compared to existing methods.
Achieving state-of-the-art camera pose estimation accuracy and generalization through a novel combination of geometric and Gaussian Splatting techniques.
Despite substantial progress in visual localization, from scene coordinate regression to direct camera pose regression, achieving both robust generalization and high accuracy remain challenging. This study introduces GS-CPE (Gaussian Splatting based Camera Pose Estimation), a coarse-to-fine framework for 6-DoF camera pose estimation that unifies geometry-based coarse pose estimation with robust 3D Gaussian Splatting (3DGS) warping based pose refinement. GS-CPE first estimates a coarse pose via retrieval-guided geometric pose estimation on a 3DGS scene representation, then refines it by minimizing a visibility aware masked RGB warping objective in a multi-scale optimization framework, with adaptive re-rendering. Extensive experiments on indoor and outdoor benchmarks including 7Scenes, Cambridge Landmarks, FAST-LIVO2 datasets, and a custom dataset demonstrate state-of-the-art performance, consistently outperforming in both accuracy and generalization.
