Search papers, labs, and topics across Lattice.
This paper introduces Geometry-Aware Deformable Aggregation (GADA), a novel method that addresses spatial misalignments in Gaussian Splatting by utilizing deformable offsets for iterative refinement. The approach effectively preserves high-frequency details and thin structures by correcting pixel-level inaccuracies that arise from uncertain geometry. GADA not only enhances the quality of warped images but also achieves a significant speedup, processing images at 2.13 times faster frames per second compared to previous methods.
GADA corrects spatial misalignments in Gaussian Splatting, preserving high-frequency details while achieving over twice the processing speed of existing techniques.
Gaussian Splatting has achieved significant improvements by incorporating warping-based techniques. However, such methods suffer from pixel-level inaccuracies due to uncertain geometry. This uncertainty leads to spatial misalignments in the warped images, which disrupt residual learning used in warping-based methods and fundamentally limit the gains of correction, particularly on thin structures and high-frequency details. Driven by our insight that useful visual cues are not lost but locally preserved under slight displacement, we propose Geometry-Aware Deformable Aggregation (GADA). This method introduces an iterative refinement module with deformable offsets to actively correct spatial misalignments and recover these displaced cues. Furthermore, to address the limitations of standard pipelines where visibility checks (i.e., thresholding) often discard valid pixels and multi-view warped image fusion relies on naive mean aggregation, our module is coupled with an implicit confidence weighting mechanism that selectively suppresses unreliable evidence. Consequently, our approach outperforms prior warping-based Gaussian Splatting, preserving high-frequency quality while achieving 2.13 times faster FPS.
