Search papers, labs, and topics across Lattice.
This paper introduces a novel test-time scaling approach for Vision-Language Models (VLMs) applied to Unmanned Aerial Vehicle (UAV) navigation, enhancing performance without additional training. By implementing an iterative refinement process that generates multiple navigation candidates and incorporates a self-correction mechanism, the method significantly improves trajectory accuracy and safety in complex environments. The proposed multi-criteria scoring function evaluates candidates based on safety, goal alignment, and forward progress, resulting in state-of-the-art performance for UAV navigation tasks.
Test-time scaling allows UAV navigation VLMs to self-correct and achieve state-of-the-art performance without any additional training.
Test-time scaling offers a promising method to improve the inference performance of Vision-Language Models (VLMs) without additional training. Existing approaches to vision-language navigation (VLN) for Unmanned Aerial Vehicle (UAV) typically relies on a single inference pass, which can falter in complex environments by producing suboptimal or unsafe trajectories. In this paper, we explore a simple and effective approach to apply test-time scaling to VLN for UAV. We enhance navigation reasoning through an iterative refinement process that requires no extra model training, guiding the model to re-evaluate its initial navigation plan for better accuracy and safety. Our method first prompts the model to generate multiple parallel candidates and then performs a self-correction step, achieving deeper and more robust planning without changing the underlying model. To further strengthen decision-making, we design a multi-criteria scoring function to evaluate the refined candidates based on safety, goal alignment, and forward-progress. This simple yet powerful combination enables a frozen UAV navigation VLMs to self-correct and generate more accurate and reliable flight plans, achieving SOTA performance in this task.
