Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces PairGS, a novel framework for open-vocabulary 3D Gaussian segmentation that models pairwise relations between Gaussians to improve segmentation accuracy and efficiency. By utilizing 3D Gaussian representations and constructing a relation graph, PairGS avoids the pitfalls of noisy segmentations and costly per-scene optimizations found in prior methods. The framework achieves state-of-the-art performance on segmentation benchmarks and is 50 times faster than traditional optimization-based approaches, highlighting its practical advantages.
PairGS revolutionizes 3D Gaussian segmentation by achieving state-of-the-art results while being 50x faster than existing methods.
Open-vocabulary 3D Gaussian segmentation is challenging because it requires language understanding for diverse queries and accurate separation of Gaussians along object boundaries. Prior approaches either embed language knowledge into individual Gaussians to improve query responsiveness or optimize per-Gaussian instance features to encode object identity. However, these strategies may produce noisy Gaussian segmentations or rely on cost-inefficient per-scene optimization. We propose PairGS, a framework that reframes Gaussian segmentation as modeling pairwise relations between Gaussians. 3D Gaussian representations provide rich signals for relation estimation, such as view contribution weights and multi-view mask evidence. By leveraging these cues, PairGS explicitly constructs a relation graph for segmentation without a heavy optimization process. PairGS first proposes sparse edge candidates using low-dimensional descriptors, computes precise pairwise affinities only on those candidates, and builds a hierarchical cluster tree for multi-granular querying. It achieves state-of-the-art results on open-vocabulary 3D Gaussian segmentation benchmarks, while the fast variant is 50x faster than optimization-based instance-feature approaches.