Search papers, labs, and topics across Lattice.
This paper introduces FAST-GS, which enhances 4D Gaussian Splatting (4DGS) by incorporating a Fourier Motion Modeling module to better capture complex dynamic scenes with high-frequency motion components. By decomposing motion into frequency-based sinusoidal components, the method improves both the fitting of intricate motion patterns and the long-term stability of rendered views. Extensive experiments show that FAST-GS maintains real-time rendering capabilities while significantly reducing motion artifacts and improving coherence in dynamic environments.
Fourier decomposition of motion enables unprecedented accuracy in rendering dynamic scenes, tackling the limitations of traditional polynomial models.
4D Gaussian Splatting (4DGS) excels in dynamic 3D reconstruction and real-time novel view synthesis via efficient 4D Gaussian representations and parallelizable rendering. However, existing 4DGS approaches rely on a single polynomial to model motion, which limits performance in complex dynamic scenes where high-frequency motion components are prevalent, and fails to ensure long-term stability due to cumulative trajectory drift. To address these issues, we propose a Fourier Motion Modeling module: this paradigm decomposes motion into frequency-based sinusoidal components, capturing both low-frequency global trajectories and high-frequency local details to model complex motion patterns accurately. It retains the real-time rendering capability of 4DGS while improving complex motion fitting and long-term coherence. Additionally, we integrate a motion-aware regularization strategy into the loss function: it uses frequency-dependent weights to suppress high-frequency jitter while preserving low-frequency motion coherence. Extensive experiments on N3V and Google Immersive datasets from multiple scenarios demonstrate the effectiveness of our method.
Tsinghua AI