Search papers, labs, and topics across Lattice.
This paper introduces MiGA, a comprehensive multi-gripper-aware dataset that includes 103,000 demonstrations across five distinct gripper types, addressing the limitations of existing vision language action models (VLAs) that often overlook the embodiment-dependent nature of grasping strategies. The authors propose GVLA, which integrates a novel multi-gripper tokenizer with adapter-based policy routing, allowing for effective parameter sharing while maintaining strategy differentiation. Experimental results demonstrate that GVLA significantly outperforms existing baselines in both simulation and real-world settings, enhancing zero-shot generalization and few-shot adaptation capabilities for robotic manipulation tasks.
Gripper-aware models can dramatically improve robotic manipulation by tailoring strategies to specific gripper types, leading to better performance in diverse tasks.
Vision language action models (VLAs) have advanced general purpose robotic grasping and manipulation by enabling robots to interpret visual observations and natural language instructions to generate executable action sequences. However, existing VLAs often implicitly assume gripper invariance, despite grasping strategies being inherently embodiment-dependent. Different gripper types, such as parallel-jaw and suction, usually require distinct interaction strategies to achieve the same grasping objective. Moreover, current datasets for VLAs predominantly rely on parallel-jaw grippers, limiting gripper-aware learning. To address this gap, we introduce MiGA, a multi-gripper-aware dataset spanning five distinct gripper types across multiple robots with 103,000 demonstrations, explicitly capturing strategy divergence under shared task objectives. We further propose GVLA, which combines a new multi-gripper tokenizer with adapter-based policy routing. Our new gripper encoding induces structured embedding information that balances parameter sharing and strategy differentiation, while layer-wise probing confirms meaningful gripper-conditioned representations for VLAs. Intensive experiments in both simulation and real-world robots show that our GVLA outperforms the current baselines across evaluated settings. Our method also improves zero-shot generalization or few-shot adaptation to new objects or unseen tasks, and enable more efficient gripper adaptation.
