Search papers, labs, and topics across Lattice.
The paper introduces COFFAIL, a new dataset of robot manipulation skills focused on coffee preparation, containing both successful and anomalous execution episodes. This dataset addresses the gap in existing resources that often lack failure cases and multi-skill scenarios. The authors demonstrate the utility of COFFAIL by training a robot policy via imitation learning, showcasing its potential for advancing robot learning research.
Training robots on perfect data is a recipe for disaster: COFFAIL offers a dataset of both successful *and* failed robot coffee-making attempts, revealing the messy reality of real-world manipulation.
In the context of robot learning for manipulation, curated datasets are an important resource for advancing the state of the art; however, available datasets typically only include successful executions or are focused on one particular type of skill. In this short paper, we briefly describe a dataset of various skills performed in the context of coffee preparation. The dataset, which we call COFFAIL, includes both successful and anomalous skill execution episodes collected with a physical robot in a kitchen environment, a couple of which are performed with bimanual manipulation. In addition to describing the data collection setup and the collected data, the paper illustrates the use of the data in COFFAIL to learn a robot policy using imitation learning.