Search papers, labs, and topics across Lattice.
This paper introduces Vision-Only Long-Horizon Navigation (VoLN), which redefines navigation tasks by relying solely on locally observable in-scene cues rather than externally supplied route instructions. The authors develop a benchmark, VoLN-UAV, consisting of 7,210 episodes that challenge agents to navigate in complex aerial environments without GPS, revealing critical insights into the integration of visual cues and goal-directed behavior. Initial experiments with their baseline model, VoLN-MLLM, demonstrate low success rates, highlighting significant challenges in long-horizon navigation that require further exploration and innovation.
Agents relying solely on in-scene cues struggle significantly, achieving only 7.4% success in easy navigation tasks, underscoring the complexity of long-horizon navigation without external guidance.
Vision-and-Language Navigation (VLN) enables embodied agents to follow natural-language instructions. However, route-level instructions commonly encode spatial priors, such as orientation, distance, and layout, that are not explicitly available from onboard sensing at deployment in open, GPS-denied environments. Benchmark performance under such interfaces therefore jointly reflects visual navigation ability and the use of route structure explicitly supplied by the task description. As a complementary formulation, we propose Vision-Only Long-Horizon Navigation (VoLN), which shifts route-relevant information from externally supplied instructions and global guidance to locally observable in-scene cues. In VoLN, goal views specify the destination, while route-relevant information is available only through locally observable in-scene cues that the agent must detect, interpret, and select online. We instantiate VoLN for aerial navigation through VoLN-UAV, a 7,210-episode benchmark that combines long-horizon goal-directed flight, continuous 3D motion, large viewpoint changes, and context-dependent beacon selection. We further provide VoLN-MLLM as an initial reference baseline. It aligns self-supervised visual features with a structured semantic space and predicts short-horizon waypoint segments from observation history, goal views, retrieved visual--semantic tokens, and proprioception. On the five-environment Test-Unseen split, it obtains success rates of 7.4%, 4.5%, and 1.8% on Easy, Normal, and Hard episodes, respectively. These results provide an initial evaluation of VoLN and reveal substantial remaining challenges in long-horizon evidence integration, cross-view goal matching, and closed-loop stability. Project page: https://admire-ljb.github.io/VoLN-UAV/
Meta AI