Search papers, labs, and topics across Lattice.
MetaNav, a novel Vision-Language Navigation (VLN) agent, is introduced to address inefficiencies in existing training-free VLN methods by incorporating metacognitive capabilities. It integrates a 3D semantic map for spatial memory, history-aware planning to discourage revisiting, and reflective correction using an LLM to generate corrective rules when stagnation is detected. Experiments across GOAT-Bench, HM3D-OVON, and A-EQA demonstrate that MetaNav achieves state-of-the-art performance while reducing VLM queries by 20.7%, highlighting the benefits of metacognitive reasoning in VLN.
Free-exploring vision-language agents can navigate more efficiently by reasoning about *how* they explore, not just *where* to explore.
Training-free Vision-Language Navigation (VLN) agents powered by foundation models can follow instructions and explore 3D environments. However, existing approaches rely on greedy frontier selection and passive spatial memory, leading to inefficient behaviors such as local oscillation and redundant revisiting. We argue that this stems from a lack of metacognitive capabilities: the agent cannot monitor its exploration progress, diagnose strategy failures, or adapt accordingly. To address this, we propose MetaNav, a metacognitive navigation agent integrating spatial memory, history-aware planning, and reflective correction. Spatial memory builds a persistent 3D semantic map. History-aware planning penalizes revisiting to improve efficiency. Reflective correction detects stagnation and uses an LLM to generate corrective rules that guide future frontier selection. Experiments on GOAT-Bench, HM3D-OVON, and A-EQA show that MetaNav achieves state-of-the-art performance while reducing VLM queries by 20.7%, demonstrating that metacognitive reasoning significantly improves robustness and efficiency.
