Search papers, labs, and topics across Lattice.
This paper introduces TempoWAM, an adaptive execution framework for World Action Models (WAMs) that optimizes the timing of replanning based on real-time task progress rather than a fixed execution horizon. By employing a Recurrent Progress Monitor to assess task advancement and an Adaptive Execution Protocol for decision-making, TempoWAM effectively adjusts execution strategies to enhance efficiency and success rates. Experimental results demonstrate that TempoWAM reduces inference requirements by 26.9% on simpler tasks while boosting success rates by 13.3 points on more challenging tasks, showcasing its practical benefits in both simulated and real-world environments.
Fixed execution horizons in WAMs are inefficient, but TempoWAM's adaptive replanning can cut inference needs by nearly 27% while improving success rates on complex tasks.
World Action Models (WAMs) jointly predict future actions and the evolution of the environment. At each inference, a WAM generates a chunk of actions and the robot executes a fixed prefix before replanning. We argue that this fixed execution horizon is poorly matched to execution dynamics: the chunk reliability varies across task stages, so when to replan depends on the result of accumulated execution, not on the step counts. We propose TempoWAM (Timing Execution by Monitoring Progress Online), a lightweight plug-and-play execution scheme for WAMs. A Recurrent Progress Monitor first estimates task progress from the current observation, task instruction, remaining actions, and execution history; and an Adaptive Execution Protocol then evaluates whether the chunk is advancing the task to decide if replanning is needed. To bridge the training-deployment gap, the protocol is calibrated by a task-dependent calibration factor with online adaptation. Experiments on LIBERO, RoboTwin, and real-world tasks show that TempoWAM consistently improves the efficiency-success trade-off of WAM execution. On real robots, it reduces WAM inferences by 26.9% on easy tasks while maintaining success, and improves success by 13.3 points on difficult tasks.
