Search papers, labs, and topics across Lattice.
This paper introduces SatNav, a novel, scalable benchmark for long-horizon UAV vision-language navigation (VLN) using high-resolution satellite imagery to overcome the limitations of 3D-asset-dependent benchmarks. SatNav comprises 118K episodes across 18 cities, featuring three task families (Boundary, Landmark, Route) designed to challenge long-term memory and geospatial reasoning in city-scale navigation. Benchmarking reveals current VLN agents struggle with this scale, while satellite-to-UAV transfer experiments demonstrate the practical utility of satellite-trained models.
City-scale UAV navigation with satellite imagery reveals current VLN agents forget 40% of context after 379m, necessitating new memory architectures.
Urban uncrewed aerial vehicle (UAV) vision-language navigation (VLN) requires agents to follow instructions across extended urban spaces, inherently demanding long-term memory and geospatial grounding. However, scaling existing benchmarks remains difficult because of their reliance on costly reconstructed 3D assets, limiting geographic diversity and episode scale. To address this, we introduce SatNav, a scalable, long-horizon UAV VLN benchmark built from high-resolution satellite imagery. SatNav targets city-level navigation missions and uses satellite crops as approximations of UAV nadir views for visual observations. Through an automated cue-to-episode pipeline, SatNav constructs 118K episodes from 59 scenes across 18 cities, with an average trajectory length of 379 m. To stress-test long-horizon memory and geospatial reasoning, SatNav defines three task families: Boundary, Landmark, and Route, targeting loop progress tracking, landmark-based spatial grounding, and route following with counting cues. Benchmarking classical VLN agents and recent agents based on large vision-language models (LVLMs) on SatNav shows that city-scale navigation remains challenging. We further introduce SwiftVLN, a modular framework with switchable memory components, and conduct systematic memory-design ablations. Finally, satellite-to-UAV transfer experiments show that satellite-trained navigation models can operate on real-flight UAV observations, showing the practical relevance of SatNav. Our project page: https://eku127.github.io/SatNav/