Search papers, labs, and topics across Lattice.
This paper introduces ReflectVLN, a vision-language navigation framework that enhances decision-making through a closed-loop mechanism involving intention and execution agents. By employing bidirectional communication, the intention agent decomposes tasks and generates corrective plans, while the execution agent translates these into actionable steps and monitors progress. Experimental results demonstrate that ReflectVLN significantly improves success rates and path efficiency on standard benchmarks, all while maintaining lower training costs and providing interpretable decision-making processes.
ReflectVLN's closed-loop mechanism allows navigation agents to dynamically adapt and recover from errors, leading to a notable increase in success rates and efficiency.
Existing vision-language navigation methods often couple a VLM with waypoint decoders to produce multi-step action plans, but they typically lack an explicit closed-loop mechanism for tracking semantic progress, diagnosing execution failures, and recovering from error accumulation in long-horizon navigation. To address this gap, we propose ReflectVLN, an agentic VLN framework that organizes decision-making through bidirectionally interactive intention and execution agents. The intention agent performs subtask decomposition and reflection, generating executable subtask descriptions as corrective plans. Conditioned on these descriptions, the execution agent grounds them into short-horizon actions under current observations while monitoring sub-goal progress and detecting off-track behavior. Crucially, ReflectVLN enables closed-loop bidirectional communication: the execution agent emits progress and deviation signals to trigger reflection and subtask updates on demand, and the intention agent returns structured guidance that reconditions subsequent actions for recovery. To encourage temporally coherent decisions with interpretable intermediate rationales, we introduce Action Chain-of-Thought (Action-CoT), a path-conditioned dual-query training scheme for action generation. Experiments on standard VLN benchmarks show that ReflectVLN improves success rates and path efficiency under a constrained data budget, with favorable training cost and fewer high-level intention calls at inference time, while providing interpretable intermediate decisions for analysis and collaboration. Code is available at: https://github.com/AIprogrammer/ReflectVLN
