Search papers, labs, and topics across Lattice.
The paper introduces HABIT, a large-scale dataset designed for robot manipulation in human-present environments, addressing the limitations of existing datasets that lack human interaction. By categorizing tasks into three distinct roles鈥擟ollaborator, Coworker, and Supervisor鈥攖he dataset captures a wide range of human-robot interactions. Experiments reveal that training on HABIT significantly enhances robots' human-aware behaviors, such as spatiotemporal synchronization and gesture grounding, which are absent in traditional robot-only datasets.
Training robots on human-present data leads to significantly improved human-aware behaviors, highlighting the critical role of human interaction in robotic learning.
Large-scale demonstration datasets have been central to recent progress in general-purpose robot policies. However, existing datasets are collected in human-absent settings, and policies trained on such data may perform tasks competently in isolation but fail to exhibit human-aware behaviors. To address this gap, we introduce HABIT, a large-scale robot demonstration dataset for human-present environments. We organize tasks into three roles capturing distinct modes of human-robot interaction: Collaborator, where human and robot jointly accomplish a task; Coworker, where they pursue separate tasks in a shared space; and Supervisor, where the human directs the robot. The dataset comprises over 10K episodes and over 160 hours across 60 tasks. Our experiments show that training on human-present data elicits human-aware behaviors that robot-only data fails to produce: spatiotemporal synchronization in Collaborator tasks, yielding in Coworker tasks, and gesture grounding in Supervisor tasks. Moreover, training on HABIT enables rapid adaptation to new human-robot interaction tasks. By introducing human presence as a new axis of dataset diversity, HABIT extends robot policies to environments shared with humans.
