Search papers, labs, and topics across Lattice.
This paper introduces UAV-VLN-FOV, a novel task that isolates the see-and-reach stage in UAV Vision-Language Navigation, allowing for a more precise evaluation of a UAV's ability to ground visible targets and execute accurate 3D motion. The authors propose the 3DG-VLN framework, which utilizes dynamic 3D direction cues and high-resolution observations to enhance visual grounding and spatial alignment during navigation. Experimental results demonstrate that 3DG-VLN achieves a 13.82% improvement in success rate over existing baselines, showcasing its effectiveness in real-world navigation scenarios.
UAVs can now achieve 13.82% better success rates in precise navigation tasks by effectively grounding visible targets and adapting to dynamic environments.
UAV Vision-Language Navigation (UAV-VLN) is typically formulated as a holistic search-and-reach problem, where long-range target discovery and final target approach are optimized and evaluated jointly. This formulation makes it difficult to assess a critical capability of aerial embodied agents, namely whether a UAV can accurately ground a visible target and translate vision-language evidence into precise 3D motion once the target enters its field of view. To address this limitation, we introduce UAV-VLN-FOV, a target-visible navigation task that isolates the see-and-reach stage and enables a more diagnostic evaluation of terminal reaching ability. We further propose 3DG-VLN, a vision-language waypoint prediction framework guided by dynamic 3D direction cues to enhance fine-grained visual grounding and spatial direction alignment for precise target reaching. Specifically, 3DG-VLN adaptively processes high-resolution front-view and downward-view observations to preserve fine-grained visual and geometric details for target grounding. It also updates the target-relative direction online during closed-loop navigation, allowing the agent to maintain spatial alignment with the target and reduce accumulated direction drift. To support this task, we construct a dedicated high-resolution benchmark which contains 2,717 trajectories with target-oriented high-level instructions, high-resolution front-view and downward-view egocentric observations, and continuous 3D waypoint annotations. Experiments show that 3DG-VLN outperforms competitive UAV-VLN baselines, achieving a 13.82\% improvement in success rate. Real-world trials further demonstrate the potential of 3DG-VLN for practical see-and-reach navigation. The source code and benchmark are available at https://github.com/xuefanfu/3DG-VLN.
