Search papers, labs, and topics across Lattice.
This paper introduces ABC, an open-source framework for behavior cloning that includes the ABC-130K dataset, the largest teleoperation dataset available, comprising 3,500 hours of data across 195 tasks. The authors provide a comprehensive toolkit that includes hardware, training infrastructure, and a simulation pipeline, enabling researchers to evaluate model designs and training strategies before costly real-world testing. Their findings demonstrate that policies trained using this framework can effectively perform complex dexterous tasks, highlighting the potential for scalable and reproducible research in robotic manipulation.
The ABC framework empowers researchers with the largest open-source teleoperation dataset and a complete toolkit to accelerate advancements in behavior cloning for robotic manipulation.
We introduce ABC, a fully open-source stack for manipulation with behavior cloning. At its core is ABC-130K: the largest open-source teleoperation dataset to date, featuring 3,500 hours of data spanning over 130K episodes across 195 diverse tasks. Furthermore, we open-source our accessible hardware setup, training infrastructure, and simulation pipeline. We also release 400 hours of sim-teleop data and provide a co-training recipe that produces correlated simulation and real-world evaluation, offering a reliable proxy for ablating model-design and training decisions before costly real-world evaluation. We explore various training recipes and compare common architectural choices for Diffusion Transformers (DiT) and Vision-Language-Action (VLA) models, grounding our findings in real-world evaluations. The resulting policies successfully execute dexterous tasks such as box folding and extracting credit cards from wallets. By providing a reproducible toolkit, we aim to place researchers on an equal footing, establishing the necessary foundation to learn the ABCs of Behavior Cloning together as a community.
Amazon Science
BAIR
CMU ML