Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces R5DGS, a novel approach to dynamic scene reconstruction that combines 4D Gaussian Splatting with semantic awareness and rigid body constraints. They augment the Gaussian representation with Identity Encoding vectors for object association and use a CLIP-based lookup table for open-vocabulary text prompting of object-specific Gaussians. By applying rigid-body constraints to object centroids and propagating motion to associated Gaussians, R5DGS achieves an 11 FPS speedup during extrapolation while maintaining trajectory plausibility.
Unlock real-time dynamic scene understanding: R5DGS achieves 11 FPS extrapolation by intelligently applying rigid body constraints to semantically-aware 4D Gaussians.
Reconstructing and predicting dynamic 3D scenes from multi-view videos is a foundational task for robotics, AR/VR, and digital twins. Recent physics-informed Gaussian Splatting methods achieve impressive future frame extrapolation but lack semantic awareness and suffer from large computational overhead. We introduce $\textbf{R5DGS}$, a framework that augments a physics-driven 4D Gaussian representation with compact Identity Encoding vectors, enabling precise Gaussian-to-object association. By constructing an offline CLIP-based object lookup table, we support open-vocabulary text prompting to retrieve and render object-specific Gaussians across arbitrary timestamps and viewpoints. Furthermore, we propose a rigid-body inference constraint that predicts and integrates physical dynamics exclusively for object centroids, propagating motion to associated Gaussians via relative transformations. This optimization yields a 11 FPS speedup during extrapolation without compromising trajectories plausibility.