Search papers, labs, and topics across Lattice.
This paper addresses the limitations of existing dynamic 3D Gaussian Splatting (3DGS) methods, which rely on static densification strategies that fail to adequately capture temporal motion in dynamic scenes. The authors introduce a Visibility-Aware Densification (VAD) framework that incorporates temporal visibility into the densification process, along with a Temporally-Adaptive Thresholding (TAT) mechanism to optimize Gaussian refinement based on lifespan. Their approach significantly enhances the visual quality of dynamic regions, demonstrating superior performance across multiple benchmark datasets and offering a versatile plug-and-play solution for various 3DGS methods.
Dynamic scenes can be accurately reconstructed with a new framework that adapts Gaussian densification based on temporal visibility, leading to sharper and more coherent visual outputs.
Despite modeling temporal motion, dynamic 3D Gaussian Splatting (3DGS) methods still inherit a static densification strategy that is ill-suited for dynamic scenes. This neglect of temporal behavior leads to under-reconstructed and blurry dynamic regions, as short-lived Gaussians receive sparse supervision and fail to densify effectively. We propose a Visibility-Aware Densification (VAD) framework that integrates temporal visibility into the densification process, ensuring that Gaussians are refined based on their actual temporal presence. A Temporally-Adaptive Thresholding (TAT) mechanism further adjusts each Gaussian's densification threshold according to its temporal lifespan, promoting balanced refinement of both static and dynamic regions. Finally, a Temporal Offset Warping (TOW) design enhances deformation capacity around temporal centers, extending the lifespan of highly dynamic Gaussians and facilitating more effective densification. Our approach achieves substantial improvements in the visual quality of dynamic regions, outperforming existing methods across three dynamic multi-view benchmark datasets. Moreover, the proposed VAD module generalizes across diverse dynamic 3DGS methods, consistently improving dynamic reconstruction as a plug-and-play component.