Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces SHARE, a user-centric SLAM system designed to enhance human-robot collaboration in shared environments by prioritizing the latency-sensitive needs of AR users over those of robots. By creating an experience model for heterogeneous agents, SHARE adaptively adjusts transmission priorities and leverages visual feature redundancy to minimize computation time at the edge. The system achieves a notable 43.3% reduction in latency for AR users while maintaining high tracking accuracy, significantly improving user perception in real-world applications.
SHARE reduces AR user latency by 43.3%, revolutionizing how we prioritize user experience in human-robot collaboration.
Human-Robot Collaboration (HRC) in shared physical spaces using Augmented Reality (AR) interfaces is powered by Simultaneous Localization and Mapping (SLAM). Existing multi-agent SLAM systems rely on an edge server to combine visual findings of multiple resource-constrained agents, perform computation, and schedule updates to their local maps. However, the edge treats all agents uniformly and ignores the fundamentally different latency requirements of heterogeneous HRC agents: robots and head-mounted AR users. This uniform resource allocation often results in high lag for user manipulation, as it does not meet the stringent latency requirements of AR. In this work, we design, implement, and evaluate SHARE, a user-centric SLAM system that strategically prioritizes AR user experience while maintaining accurate tracking performance for robots. SHARE builds a first-of-its-kind experience model for HRC agents and adaptively adjusts transmission priorities to match it. To reduce end-to-end latency, SHARE leverages the redundancy of visual features acquired by agents in shared human-robot workspaces to reduce computation time induced by edge-based processing. Real-world deployment with commercial AR headsets and a ground robot achieves 13.22 ms average latency for AR users (43.3% reduction from baseline) while maintaining sub-2-centimeter tracking accuracy. User studies further reveal statistically significant improvements in user perception.