Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces VISTA, a novel approach to visual navigation that enhances the robustness of Vision Navigation Models (VNMs) by conditioning on normalized action histories in addition to image observations. This method addresses the critical vulnerability associated with scaling factors that can distort normalized trajectories, thereby improving navigation performance and reducing collision risks. VISTA achieves remarkable generalization, attaining 100% goal prediction accuracy in zero-shot deployments across diverse real-world environments, including outdoor, forest, and office settings.
Conditioning on action history allows VISTA to maintain navigation accuracy and safety, even when scaling factors vary across environments.
Vision Navigation Foundation Models (VNMs) promise end-to-end learned navigation policies capable of zero-shot deployment across diverse embodiments and environments. To maintain generality, many vision-based navigation models predict normalized actions. However, this normalization introduces a critical deployment vulnerability: applying different scaling factors to the same normalized trajectory alters its physical geometry, which degrades navigation performance and increases collision risks. We address this vulnerability by conditioning the model on normalized action histories alongside image observations, providing explicit context on the relationship between the model's predictions and the robot's actual physical displacement. Furthermore, current VNMs often struggle in visually repetitive environments that lack distinct features. To resolve this issue, we integrate a DINOv3 encoder, whose richer representations enable our model to capture both spatial and geometric dimensions between observations. VISTA generalizes robustly to out-of-distribution environments, achieving 100% goal prediction accuracy in zero-shot, real-world deployment in Outdoor, Forest and Office settings, and an average of 95% checkpoints crossed, demonstrating consistent path following in unseen environments.