Search papers, labs, and topics across Lattice.
LiveVLN addresses the stop-and-go behavior of Vision-Language Navigation (VLN) agents by overlapping action execution with the processing of new observations. This is achieved by augmenting pretrained VLMs with a multi-step action continuation mechanism that generates future actions before the current action sequence is exhausted. Experiments on R2R, RxR, StreamVLN, and NaVIDA show that LiveVLN reduces waiting time by up to 77.7% and shortens wall-clock episode time by up to 19.6% without sacrificing benchmark performance.
VLN agents can navigate almost 20% faster in the real world simply by predicting multiple future actions and overlapping execution with perception.
Recent navigation systems achieve strong benchmark results, yet real-world deployment often remains visibly stop-and-go. This bottleneck arises because the sense-inference-execution loop is still blocking: after each new observation, the controller must wait for sensing, transmission, and inference before motion can continue. Reducing action-generation cost alone therefore does not remove redundant waiting. To address this issue, we present LiveVLN, a training-free framework for more continuous embodied navigation by augmenting pretrained VLM navigators with multi-step action continuation. Instead of pausing for each full sense-and-inference round, LiveVLN overlaps execution with the processing of newly arrived observations, allowing refreshed future actions to be handed off before the current executable prefix is exhausted. This design keeps actions continuously available during motion, reducing idle waiting and enabling smoother online execution. The framework operates at runtime and can be integrated with compatible pretrained VLM navigators. Across R2R and RxR, LiveVLN preserves benchmark performance while reducing waiting time and improving action availability. In real-world deployments, it cuts average episode waiting time by up to $77.7\%$ and shortens wall-clock episode time by $12.6\%$ on StreamVLN and $19.6\%$ on NaVIDA, yielding more coherent execution during deployment. Code is available at https://github.com/NIneeeeeem/LiveVLN.
