Search papers, labs, and topics across Lattice.
This paper introduces CanonicalGS, a novel feed-forward pipeline that enhances real-time novel view synthesis by transforming cluttered multi-view observations into a stable, scene-centric representation. By utilizing depth, semantic features, and uncertainty estimates, CanonicalGS effectively aggregates reliable observations while minimizing the impact of noisy or redundant data. Experimental results demonstrate significant improvements, achieving up to a 2.5 dB increase in peak signal-to-noise ratio for novel view synthesis and an 11% boost in semantic segmentation accuracy.
CanonicalGS achieves a remarkable 2.5 dB improvement in novel view synthesis quality by stabilizing scene representations against noisy input data.
Feed-forward Gaussian splatting (FFGS) facilitates real-time novel view synthesis, yet current methods often remain tied to view-dependent predictions. As more input views are added, they may accumulate noisy or redundant evidence instead of converging to a stable scene representation. In this paper, we introduce CanonicalGS, a feed-forward pipeline that maps cluttered multi-view observations into a stable, scene-centric representation. CanonicalGS first extracts view-centric evidence from depth, semantic features, and uncertainty estimates, and then aggregates this evidence in a canonical latent world using uncertainty-aware fusion. By emphasizing reliable observations while suppressing uncertain or redundant ones, CanonicalGS produces representations that scale more effectively for novel view synthesis and transfer to downstream visual perception tasks. Experiments show up to a $2.5$ dB improvement in peak signal-to-noise ratio for synthesizing novel views and an $11\%$ gain in semantic segmentation accuracy.
