Search papers, labs, and topics across Lattice.
This paper introduces Intrinsic-GS, a training-free and mask-free method for segmenting dynamic 4D Gaussian representations by constructing a sparse affinity graph from intrinsic scene cues such as appearance and deformation trajectories. The method achieves significant segmentation performance on standard benchmarks, with a mean Intersection over Union (mIoU) of 0.746 on Neu3D and 0.575 on HyperNeRF, while a geometry-only variant reaches 0.902 mIoU, matching the performance of mask-supervised methods. Notably, Intrinsic-GS operates 12.5 times faster than traditional pipelines that rely on external mask generation, highlighting the potential for efficient segmentation directly from Gaussian primitives.
Segmentation can be achieved directly from 4D Gaussian representations without the need for costly external masks, revealing that intrinsic scene cues hold significant object structure information.
Dynamic 4D Gaussian Splatting reconstructs deforming scenes with high fidelity and is increasingly adopted as a representation for dynamic 3D scenes. Putting such a scene to use, for editing, manipulation or motion analysis, first requires segmenting it: grouping the Gaussian primitives into coherent objects. Current pipelines obtain this grouping by importing 2D masks from foundation models such as SAM and lifting or distilling them into the Gaussian representation. In dynamic scenes these masks must be generated across many frames and views, which is costly, and the resulting segmentation can depend strongly on the quality and consistency of those external masks. We ask how much object-level structure can instead be recovered from the Gaussians themselves, and propose Intrinsic-GS, a training-free, mask-free method that builds a sparse affinity graph over Gaussian primitives from appearance, orientation, scale, deformation-trajectory and non-learned rendered-boundary cues. The graph is partitioned with Leiden community detection, requiring no foundation model and no learned feature field. On the standard 4D Gaussian segmentation benchmarks, Neu3D and HyperNeRF, Intrinsic-GS recovers substantial object structure without mask supervision, reaching 0.746 mIoU on Neu3D and 0.575 on HyperNeRF; on Neu3D, a geometry-only variant reaches 0.902 mIoU, matching SAM-supervised TRASE. On HyperNeRF, Intrinsic-GS runs 12.5x faster than the mask-generation and feature-rendering stages used by mask-supervised pipelines. These results suggest that much of the segmentation signal is already encoded in the Gaussians themselves, offering a fast, mask-free direction for 3D and 4D Gaussian segmentation that may also point toward more generalizable, robust segmentation in settings where external masks are unreliable or expensive.
