Search papers, labs, and topics across Lattice.
This study investigates the ability of a Mixture-of-Experts (MoE) action head in a Variable-Length Architecture (VLA) to learn compositional robot policies directly from expert demonstrations, without predefined task hierarchies. The results reveal that the MoE can effectively decompose tasks into reusable and interpretable primitives, with learned experts being reused across different tasks and exhibiting distinct low-level behaviors. Notably, the MoE achieves comparable task performance to a traditional monolithic model while showcasing significant expert specialization, paving the way for more modular and interpretable robotic systems derived from data alone.
Emergent task decomposition in robot policies reveals that learned experts can specialize and be reused, challenging traditional notions of task hierarchy in AI.
We consider the problem of learning compositional robot policies end-to-end from expert demonstrations, without any pre-specified notion of task decomposition or hierarchy. We ask whether a VLA trained with a simplified Mixture-of-Experts (MoE) action head can emergently learn to decompose tasks into reusable, interpretable primitives. We find that learned experts are heavily reused across tasks and consistently correspond to qualitatively distinct low-level behaviors, suggesting that the router implicitly learns to perform high-level sequencing while experts serve as compositional primitives. Our MoE matches the task performance of a monolithic baseline while demonstrating meaningful expert specialization, a step toward modular, interpretable robot policies that emerge from data alone.
