Search papers, labs, and topics across Lattice.
This paper introduces QueryGaussian, a training-free framework designed for efficient open-vocabulary 3D instance retrieval using natural language prompts. By employing an instance-level query mechanism that separates semantic understanding from geometric representation, QueryGaussian significantly reduces memory usage by over 70% and accelerates inference speed by 180x compared to existing methods. The approach enables effective retrieval in complex city-scale environments with tens of millions of 3D instances, demonstrating both high accuracy and remarkable efficiency on consumer-grade hardware.
QueryGaussian achieves a 180x speedup in 3D instance retrieval while slashing GPU memory usage by over 70%, making it feasible on consumer-grade hardware.
Efficiently retrieving specific 3D instances from large-scale scenes via natural language prompts remains a formidable challenge in multimedia analysis. Existing approaches predominantly follow a "scene-level embedding" paradigm, which requires distilling high-dimensional semantic features into every 3D primitive. This strategy suffers from a fundamental architectural bottleneck: memory and computational costs scale linearly with scene complexity, inevitably triggering out-of-memory (OOM) failures in city-scale environments. To address this barrier, we propose QueryGaussian, a training-free framework for expeditious and scalable open-vocabulary 3D instance retrieval. Unlike holistic semantic distillation, QueryGaussian employs an instance-level query mechanism that decouples semantic understanding from geometric representation. Specifically, we leverage pre-trained 2D vision models to interpret user prompts and lift segmentation masks into 3D via a concurrent maximum-weight association strategy, ensuring semantic-visual consistency. To mitigate projection ambiguity, we introduce a temporal fusion module with multi-stage adaptive density clustering. Experimental results demonstrate that QueryGaussian not only matches the accuracy of state-of-the-art methods but also delivers a decisive efficiency leap, reducing GPU memory usage by over 70% and accelerating inference by 180x. Crucially, QueryGaussian enables expeditious instance retrieval on city-scale scenes containing tens of millions of Gaussians using consumer-grade hardware.
