Search papers, labs, and topics across Lattice.
PrimitiveVLA addresses the data inefficiency and poor generalization of Vision-Language-Action (VLA) models in robotic manipulation by learning reusable motion primitives. The framework decomposes demonstrations into primitives during fine-tuning using a Multimodal Canonical Representation (MCR) and then assembles these primitives at inference time using a VLM-based planner and LLM-generated switch module. Experiments demonstrate improved data efficiency and zero-shot generalization to unseen and long-horizon tasks compared to direct instruction-to-control mapping.
Forget monolithic trajectories: PrimitiveVLA teaches robots reusable motion primitives, boosting data efficiency and zero-shot generalization in manipulation tasks.
Vision-Language-Action (VLA) models offer a promising paradigm for generalist robotic policies, yet their adaptation is hindered by data inefficiency and poor generalization. We argue that these bottlenecks stem from the prevailing Direct Instruction-to-Control Mapping, which forces models to memorize monolithic trajectories rather than reusable motion patterns, i.e., primitives. We propose PrimitiveVLA, a framework that shifts this paradigm toward a Primitive-Centric Disassemble & Assemble paradigm. Supported by a shared Multimodal Canonical Representation (MCR), PrimitiveVLA unifies two phases: (1) Fine-tuning-phase Disassembly, which uses an automated pipeline to disassemble demonstrations into reusable primitives; and (2) Inference-phase Assembly, which employs a VLM-based planner and an LLM-generated switch module for robust closed-loop execution. By disassembling tasks into reusable primitives, PrimitiveVLA enables VLA models to learn invariant motion patterns instead of task-specific trajectories. Extensive experiments show that our framework improves data efficiency and achieves superior zero-shot generalization across unseen and long-horizon tasks.
