Search papers, labs, and topics across Lattice.
This paper introduces the Bernoulli-Continuation Policy (BCP), a novel framework that enables adaptive execution horizons in Vision-Language-Action (VLA) models by allowing for dynamic decisions on whether to continue executing or to replan. By employing reinforcement learning and a unique Replanning-Efficiency Reward, BCP effectively improves task success rates across various settings, achieving significant performance gains on both simulated and real robotic tasks. The results show an average success rate increase of 11.08% on low-success tasks and a notable improvement from 74% to 92% on real robot manipulation tasks, all while maintaining lower runtime overhead compared to fixed-horizon baselines.
Adaptive execution horizons can boost task success rates by over 11% while reducing runtime overhead in Vision-Language-Action models.
Existing chunk-based Vision-Language-Action (VLA) models execute a fixed number of actions (i.e., execution horizon) before replanning, turning replanning into a task-agnostic periodic schedule that is independent of task progress. As a result, when no replanning boundary falls before a critical manipulation stage, it is executed from a stale chunk rather than a freshly replanned one. To address this limitation, we propose Bernoulli-Continuation Policy (BCP), a lightweight, plug-and-play framework for adaptive horizon execution that keeps the base VLA frozen. Given a fixed-length action chunk, its continuation head decomposes execution-horizon selection into a sequence of continue-or-replan decisions, which imposes an ordinal, prefix-sharing inductive bias over candidate horizons rather than treating them as independent classes. Since the optimal horizon for each chunk is not observable, we train this head with reinforcement learning from trajectory-level outcomes and introduce a Replanning-Efficiency Reward that jointly rewards task success and efficient VLA usage, discouraging the policy from collapsing to unnecessarily short horizons. On RoboTwin 2.0 with LingBot-VLA as the base policy, BCP improves the average success rate by +11.08% on 13 low-success tasks and from 89.88% to 93.94% (+4.06%) across all 50 tasks. Although trained only under the Clean setting, BCP generalizes to the Randomized setting, raising the average success rate by +4.06%. It also transfers to a different base policy $\pi_{0.5}$, achieving a better result on LIBERO (+1.7%) and, notably, on the harder LIBERO-PRO (+6.8%). On a real robot, BCP lifts success from 74% to 92% and from 44% to 84% on two manipulation tasks. Meanwhile, its negligible overhead, combined with higher success, makes BCP's overall runtime even lower than the fixed-horizon baselines.
Microsoft Research