Search papers, labs, and topics across Lattice.
This paper introduces ViSA, a Visual-Spatial Reasoning enhanced framework for aerial Vision-Language Navigation (VLN) that addresses limitations in spatial reasoning and linguistic ambiguity of existing detection-and-planning pipelines. ViSA employs a triple-phase collaborative architecture using structured visual prompting to enable VLMs to reason directly on image planes without additional training. Experiments on the CityNav benchmark show ViSA achieves a 70.3% improvement in success rate compared to state-of-the-art methods, demonstrating its potential as a backbone for aerial VLN systems.
Achieve a 70% boost in aerial navigation success by prompting VLMs to reason directly on image planes, sidestepping reliance on intermediate scene graphs.
Existing aerial Vision-Language Navigation (VLN) methods predominantly adopt a detection-and-planning pipeline, which converts open-vocabulary detections into discrete textual scene graphs. These approaches are plagued by inadequate spatial reasoning capabilities and inherent linguistic ambiguities. To address these bottlenecks, we propose a Visual-Spatial Reasoning (ViSA) enhanced framework for aerial VLN. Specifically, a triple-phase collaborative architecture is designed to leverage structured visual prompting, enabling Vision-Language Models (VLMs) to perform direct reasoning on image planes without the need for additional training or complex intermediate representations. Comprehensive evaluations on the CityNav benchmark demonstrate that the ViSA-enhanced VLN achieves a 70.3\% improvement in success rate compared to the fully trained state-of-the-art (SOTA) method, elucidating its great potential as a backbone for aerial VLN systems.
