Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces DART-VLN, a test-time control framework designed to enhance the performance of memory-based discrete vision-language navigation (VLN) agents under partial observability. By implementing Test-Time Memory Decay and Anti-Loop Regularization, the framework effectively suppresses stale evidence and discourages inefficient local backtracking during action selection, all without altering the learned backbone or introducing new parameters. Experimental results on R2R and REVERIE demonstrate that the combination of these techniques leads to shorter navigation trajectories, reduced runtime, and improved overall performance, highlighting the potential for modest test-time adjustments to significantly enhance VLN reliability and efficiency.
Test-time control can dramatically improve the reliability and efficiency of memory-based VLN agents without the need for retraining.
Memory-based discrete vision-language navigation (VLN) agents must act under partial observability, yet even strong frozen backbones remain vulnerable at test time. Two common failure modes are stale historical evidence at memory readout and inefficient local backtracking during action selection. We present DART-VLN, a training-free test-time control framework for discrete VLN. DART-VLN combines Test-Time Memory Decay, a read-side memory reweighting rule that suppresses stale and redundant evidence without rewriting stored content, with Anti-Loop Regularization, a lightweight next-hop penalty that discourages immediate reversals during action selection. The framework introduces no new learnable parameters and leaves the learned backbone unchanged. Experiments on R2R and REVERIE show a consistent pattern: decay-only provides stable read-side gains, while decay+anti-loop achieves the best overall quality-efficiency trade-off, yielding shorter trajectories, lower runtime, and improved navigation performance in key settings. Behavioral analysis further confirms that anti-loop regularization reduces local backtracking and improves path efficiency under frozen backbones. Overall, the results show that modest test-time control can make memory-based discrete VLN more reliable and efficient without retraining.