Search papers, labs, and topics across Lattice.
This paper introduces ARTOO-DARTU, an augmented reality (AR) system designed to enhance human-robot collaboration (HRC) in warehouse settings by mitigating obstructions that can hinder visibility and task performance. The system employs an obstruction detection and mitigation (ODM) pipeline, which allows for real-time robot feedback while ensuring that critical real-world elements remain visible. Results from a user study with 34 participants showed a 46% increase in overall task efficiency and a 61% improvement in subtasks requiring real-world visibility when the ODM was active, underscoring the importance of unobstructed AR analytics in HRC scenarios.
Real-time robot feedback in augmented reality can boost task efficiency by 46% when obstructions are effectively managed.
Human-robot collaboration (HRC) often requires robot intentions and internal states to be conveyed to users for task efficiency and safety. Recently, augmented reality (AR) situated analytics provide such real-time robot feedback in HRC contexts. However, AR situated analytics can obstruct important real-world elements, posing safety and usability risks, especially when content is dynamically positioned relative to movements of mobile robots in a warehouse HRC scenario. In this paper, we introduce the Augmented Reality Technique Of Obstruction Deterrence while Aiding Robotic Teaming for Users (ARTOO-DARTU), an AR system tailored specifically for warehouse HRC that enables real-time robot situated analytics and control while preserving visibility of the real world through an obstruction detection and mitigation pipeline (ODM) that is uniquely suited for AR-HRC. To evaluate ARTOO-DARTU, we developed Pocket MonstARs, a controlled gamified abstraction of HRC warehouse inventory picking in which virtual monsters serve as proxies for pick targets, while labeled and object-marked boxes preserve the real-world identification demands of the picking task. In a 34-participant user study, we found that our designed AR situated analytics yielded a 46% increase in efficiency on the overall HRC task, but only when the ODM was active. Participants with the ODM active were also 61% faster on subtasks requiring visibility of the real world. Our findings demonstrate that, when paired with our developed ODM to prevent real-world obstructions, the situated analytics in ARTOO-DARTU can significantly enhance efficiency and user experience in AR-HRC warehouse scenarios.
