Search papers, labs, and topics across Lattice.
The paper introduces Context-Nav, a zero-shot approach for text-goal instance navigation (TGIN) that leverages contextual captions for global exploration and 3D spatial reasoning for candidate verification. It uses dense text-image alignments to create a value map that guides exploration and then performs viewpoint-aware relation checks to verify candidate objects by sampling plausible observer poses and aligning local frames. Context-Nav achieves state-of-the-art performance on InstanceNav and CoIN-Bench without task-specific training, demonstrating the effectiveness of geometry-grounded spatial reasoning.
Skip the costly policy training: this zero-shot method nails text-goal instance navigation by grounding language in 3D geometry for smarter exploration and verification.
Text-goal instance navigation (TGIN) asks an agent to resolve a single, free-form description into actions that reach the correct object instance among same-category distractors. We present \textit{Context-Nav} that elevates long, contextual captions from a local matching cue to a global exploration prior and verifies candidates through 3D spatial reasoning. First, we compute dense text-image alignments for a value map that ranks frontiers -- guiding exploration toward regions consistent with the entire description rather than early detections. Second, upon observing a candidate, we perform a viewpoint-aware relation check: the agent samples plausible observer poses, aligns local frames, and accepts a target only if the spatial relations can be satisfied from at least one viewpoint. The pipeline requires no task-specific training or fine-tuning; we attain state-of-the-art performance on InstanceNav and CoIN-Bench. Ablations show that (i) encoding full captions into the value map avoids wasted motion and (ii) explicit, viewpoint-aware 3D verification prevents semantically plausible but incorrect stops. This suggests that geometry-grounded spatial reasoning is a scalable alternative to heavy policy training or human-in-the-loop interaction for fine-grained instance disambiguation in cluttered 3D scenes.
