Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper investigates the effectiveness of on-policy distillation (OPD) in enhancing the capabilities of accelerated students in world action models (WAMs) without the need for sparse-reward reinforcement learning. The authors introduce WAM-OPD, a method where a frozen teacher labels student-generated histories with coherent video and action targets, allowing the student to learn in a deployment-consistent manner. Preliminary results on RoboTwin 2.0 show significant improvements in task success rates, indicating that dense teacher supervision on student-induced histories could be a valuable approach for refining video-first WAMs.
On-policy distillation can boost task success rates in world action models by leveraging teacher supervision on student-generated histories, achieving up to 58.3% success in complex tasks.
World action models (WAMs) couple visual future prediction with robot action generation, but accelerated students can lose task capabilities during distillation and later encounter states that are poorly represented by offline data. We study whether on-policy distillation (OPD) can repair such a student without requiring sparse-reward reinforcement learning. We introduce WAM-OPD, a deployment-consistent post-training recipe for a video-first WAM. The student acts in the environment and therefore determines the history distribution. A frozen teacher labels those student histories with coherent video and action targets, while the student action branch is trained under its own generated video plan, as it is at deployment. Joint video and action losses update lightweight adapters in the shared backbone, together with an action flow-matching regularizer. In preliminary RoboTwin 2.0 studies on two tasks, the released one-video/one-action-step Flash-WAM improves from 0.0% to 58.3% success on HANDOVER MIC, and from 16.7% to 33.3% on PUT OBJECT CABINET. These task-specific results are an initial capability proof rather than evidence of broad or uniform generalization. They nevertheless suggest that dense teacher supervision on student-induced histories is a promising post-training interface for video-first WAMs.