Search papers, labs, and topics across Lattice.
This paper introduces a collaborative human-robot navigation system designed to assist blind and visually impaired (BVI) individuals with environmental interactions beyond simple wayfinding. The system alternates between a "lead mode" for guiding the user to interaction targets and an "adaptation mode" for adjusting robot motion during user interactions like opening doors. Evaluation demonstrates that the system enables safer, smoother, and more efficient navigation compared to traditional methods and non-adaptive systems, especially for tasks requiring precise target localization.
A robotic guide dog that adapts its movements to assist visually impaired users in interacting with their environment鈥攍ike opening doors or pressing elevator buttons鈥攐utperforms both white canes and non-adaptive guiding systems.
Robotic guidance systems have shown promise in supporting blind and visually impaired (BVI) individuals with wayfinding and obstacle avoidance. However, most existing systems assume a clear path and do not support a critical aspect of navigation - environmental interactions that require manipulating objects to enable movement. These interactions are challenging for a human-robot pair because they demand (i) precise localization and manipulation of interaction targets (e.g., pressing elevator buttons) and (ii) dynamic coordination between the user's and robot's movements (e.g., pulling out a chair to sit). We present a collaborative human-robot approach that combines our robotic guide dog's precise sensing and localization capabilities with the user's ability to perform physical manipulation. The system alternates between two modes: lead mode, where the robot detects and guides the user to the target, and adaptation mode, where the robot adjusts its motion as the user interacts with the environment (e.g., opening a door). Evaluation results show that our system enables navigation that is safer, smoother, and more efficient than both a traditional white cane and a non-adaptive guiding system, with the performance gap widening as tasks demand higher precision in locating interaction targets. These findings highlight the promise of human-robot collaboration in advancing assistive technologies toward more generalizable and realistic navigation support.
NUS