Track manipulation, locomotion and embodied systems.
Search papers, labs, and topics across Lattice.
This paper addresses the high inference cost of aerial vision-language navigation (VLN) agents by proposing X-Fly, a staged training framework that enables full-chunk action execution before replanning. X-Fly mitigates the significant no-stop failure rate of behavior cloning by incorporating recovery DAgger and flow-GRPO to learn robust chunked navigation and accurate stopping policies. The proposed method achieves substantial improvements in success rate on both test-seen and test-unseen aerial VLN benchmarks compared to prior full-chunk approaches.
Aerial VLN agents can achieve over 74% success by learning to execute full action chunks and stop accurately, drastically reducing inference costs and overcoming the 47% no-stop failure rate of standard behavior cloning.
Aerial vision-language navigation (VLN) agents built on large vision-language models are expensive to query. Executing a complete predicted action chunk before replanning amortizes this cost, reducing model inference from 195 to 42 ms per executed waypoint for our policy. It also moves the states at which the policy is queried away from expert demonstrations, which supervise neither recovery from these states nor termination at the learner's own arrival. On OpenFly test-seen, no-stop failures account for 47.78% of full-chunk behavior cloning (BC) outcomes. We present X-Fly, a staged training framework for full-chunk aerial VLN. Recovery DAgger labels learner-visited decision states with smooth chunks that reconnect to future expert segments and with STOP at the first in-region state. Flow-GRPO then jointly refines the chunked flow controller and a Bernoulli STOP policy from same-task closed-loop outcomes, supplemented by outcome-verified stopping supervision. With eight controls per decision, X-Fly reaches 74.18% SR on test-seen and 51.73% on test-unseen, compared with 16.45% and 18.43% for full-chunk BC and 32.04% and 29.46% for DreamFly.