Track genomics, neuroscience and molecular biology.
Search papers, labs, and topics across Lattice.
This paper addresses the challenge of consolidating specialized vision-language-action (VLA) skills into a single policy by proposing a novel two-level on-policy distillation (OPD) framework. The method tackles distribution mismatches at both environment observation and intermediate action-generation states by coupling student-driven interaction with teacher velocity supervision along student-generated action flow trajectories. This approach, termed Velocity Loss OPD, achieves significant absolute success-rate gains across multiple robotics and manipulation benchmarks, demonstrating effective multi-domain capability consolidation.
Consolidating diverse VLA skills into one policy is now achievable with a two-level on-policy distillation that leverages student-generated action flows and teacher velocity supervision, outperforming prior methods by up to 18.3% on complex tasks.
Specialized vision-language-action (VLA) policies acquire strong domain-specific skills, yet consolidating these skills into one shared policy remains challenging. On-policy distillation (OPD) transfers teacher knowledge on inputs induced by the student, addressing the distribution mismatch encountered during deployment. For flow-based VLAs, this mismatch arises at two levels: environment observations and intermediate action-generation states. We propose a two-level on-policy distillation framework that couples student-driven environment interaction with teacher velocity supervision along student-generated action flow trajectories. Frozen domain specialists jointly supervise one student. After each update, the student collects new environment experience and generates fresh action-flow trajectories. Starting from a joint supervised fine-tuning (SFT) initialization, Velocity Loss OPD yields absolute success-rate gains of 22.55% on LIBERO-40, 33.4% on CALVIN five-instruction sequences, and 22.6% on Meta-World MT50. Compared with Action Loss OPD and Teacher-rollout SFT, it achieves absolute success-rate gains of 6.4-9.5% on LIBERO-40, 9.7-18.3% on CALVIN, and 3.2-4.2% on Meta-World MT50. Analysis by sequence length further shows larger success-rate gains on longer CALVIN sequences. These results demonstrate effective multi-domain capability consolidation through two-level on-policy supervision, with a single student deployed across domains.