Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
The paper introduces SAIN, a novel framework for Interactive Instance Goal Navigation (IIGN) that enhances mobile robot navigation by transforming active dialogue into a structured, persistent navigation state. This approach addresses the challenge of ambiguous human instructions by compiling dialogue inputs into spatial and object-centric memories, which are then utilized by a unified policy for effective navigation. SAIN achieves significant performance improvements on the VL-LN IIGN benchmark, increasing success rates from 20.2% to 25.4% and SPL from 13.07 to 14.17 without requiring task-specific policy training.
Transforming ambiguous dialogue into structured navigation states boosts robot navigation success rates by over 25% without additional training.
Most existing vision-language navigation tasks assume that instructions are complete and unambiguous. However, real-world robots often encounter natural human instructions that are ambiguous, underspecified, or incomplete, requiring them to resolve such uncertainties through active questioning. Interactive Instance Goal Navigation (IIGN) requires an embodied agent to find the specific instance under an ambiguous category-level instruction through active dialogue. However, existing dialogue-enabled methods often consume oracle answers as transient textual context for immediate decisions, rather than persistent spatial or object-centric structured state. We present SAIN, a zero-shot framework that turns active dialogue into persistent navigation state. Instead of consuming oracle answers as one-step text hints, SAIN compiles them into target evidence, route-level corridor memory, and object-candidate labels. These states are stored in structured value, room, graph, and object memories, then consumed by a unified policy for frontier ranking and final target approach. On the VL-LN IIGN benchmark, SAIN improves SR from 20.2 to 25.4 and SPL from 13.07 to 14.17 over the strongest reported dialogue-enabled baseline, while requiring no task-specific policy training. The results support dialogue-to-state conversion as an effective zero-shot mechanism for long-horizon interactive instance navigation. Project website: https://zorattc.github.io/SAIN/