Search papers, labs, and topics across Lattice.
This paper introduces PruneGround, a novel framework for 3D Visual Grounding (3DVG) that utilizes Language-Guided Spatial Pruning (LGSP) to focus on relevant spatial regions, significantly reducing computational overhead. By employing MultiView-Conditioned Description Reformulation (MCDR), the framework simplifies complex referential expressions and enhances spatial understanding through multi-view reasoning. The method achieves state-of-the-art performance across multiple benchmarks, demonstrating its effectiveness in cluttered environments where traditional approaches struggle.
PruneGround cuts through the clutter, achieving state-of-the-art 3D visual grounding by intelligently narrowing the search space based on language cues.
3D Visual Grounding (3DVG) aims to localize target objects in 3D scenes given natural language descriptions. Existing approaches typically perform reasoning over the entire scene, leading to ambiguous predictions and high computational cost, especially in cluttered environments. We observe that many referential expressions rely on local spatial context and often correspond to restricted spatial regions rather than the full scene. Motivated by this insight, we propose PruneGround, an effective plug-and-play framework for 3DVG built upon three key components. First, we introduce Language-Guided Spatial Pruning (LGSP), which leverages a frozen Vision Language Model (VLM) to identify language-relevant regions, thereby reducing spatial computation and grounding candidates in the narrower search space. Second, we propose MultiView-Conditioned Description Reformulation (MCDR), which decomposes complex expressions into simplified target-anchor relations and augments missing spatial cues through multi-view reasoning. Finally, we propose LLM-Grounder, which repurposes a detection-pretrained spatial LLM into a language-conditioned grounding model by aligning point cloud and linguistic representations within the pruned region. Extensive experiments on the three most popular point cloud benchmarks demonstrate that our method achieves state-of-the-art results on all three ScanRefer settings and on 9 out of 10 Nr3D/Sr3D settings. Code and models are publicly available: https://github.com/leduckhai/PruneGround
