Search papers, labs, and topics across Lattice.
UniGround tackles 3D Visual Grounding (3DVG) by replacing reliance on pre-trained models with training-free visual and geometric reasoning for open-world generalization. It uses a two-stage approach: global candidate filtering via 3D topology and multi-view semantics, followed by local precision grounding using multi-scale visual prompting and structured reasoning. Experiments on ScanRefer and EmbodiedScan demonstrate state-of-the-art zero-shot performance on EmbodiedScan (28.7\% Acc@0.25) and robust generalization in real-world environments.
Forget finetuning: this training-free method achieves state-of-the-art zero-shot 3D visual grounding, even in messy, real-world environments.
Understanding and localizing objects in complex 3D environments from natural language descriptions, known as 3D Visual Grounding (3DVG), is a foundational challenge in embodied AI, with broad implications for robotics, augmented reality, and human-machine interaction. Large-scale pre-trained foundation models have driven significant progress on this front, enabling open-vocabulary 3DVG that allows systems to locate arbitrary objects in a given scene. However, their reliance on pre-trained models constrains 3D perception and reasoning within the inherited knowledge boundaries, resulting in limited generalization to unseen spatial relationships and poor robustness to out-of-distribution scenes. In this paper, we replace this constrained perception with training-free visual and geometric reasoning, thereby unlocking open-world 3DVG that enables the localization of any object in any scene beyond the training data. Specifically, the proposed UniGround operates in two stages: a Global Candidate Filtering stage that constructs scene candidates through training-free 3D topology and multi-view semantic encoding, and a Local Precision Grounding stage that leverages multi-scale visual prompting and structured reasoning to precisely identify the target object. Experiments on ScanRefer and EmbodiedScan show that UniGround achieves 46.1\%/34.1\% Acc@0.25/0.5 on ScanRefer and 28.7\% Acc@0.25 on EmbodiedScan, establishing a new state-of-the-art among zero-shot methods on EmbodiedScan without any 3D supervision. We further evaluate UniGround in real-world environments under uncontrolled reconstruction conditions and substantial domain shift, showing training-free reasoning generalizes robustly beyond curated benchmarks.
