Search papers, labs, and topics across Lattice.
This paper introduces Communication-enabled Social Navigation (CommNav), a novel approach that allows autonomous robots to proactively communicate with humans to locate specific individuals in multi-agent environments. By integrating a communication module into a state-of-the-art social navigation model, the authors achieved a significant 10 percentage-point improvement in episode success rates. The study also highlights the effectiveness of training on both LLM-generated and colloquial instructions, demonstrating that explicit communication greatly enhances navigation performance and robustness to natural language inputs.
Explicit human-robot communication boosts navigation success by 10 percentage points, transforming how robots interact in crowded environments.
Assistive autonomous robots operating in multi-agent environments require efficient strategies to locate specific individuals among multiple residents. Current social navigation methods focus on reactive collision avoidance and trajectory adaptation, but lack mechanisms to proactively gather information through human-robot communication. We introduce Communication-enabled Social Navigation (CommNav). In this novel task, robotic agents actively seek assistance from residents to locate target individuals by requesting information about recent sightings, locations, and movements. To evaluate CommNav, we extend Habitat 3.0 to create Habitat 3.0c, a communication-enabled variant supporting multi-human environments with information exchange protocols. Adding our communication module (COMM) to a state-of-the-art social navigation model yields a 10 percentage-point improvement in Episode Success. We further investigate the transition from structured data to natural language by evaluating models trained on LLM-generated instructions and on colloquial instructions collected from a human study. Our experiments reveal that: (i) explicit human-robot communication substantially enhances multi-person navigation performance; (ii) pre-training COMM on a communication pretext task effectively addresses the challenge of occasional interaction signals; and (iii) the navigation policy is highly robust to natural, colloquial human language, achieving an episode success statistically similar to the model using perfect structured data.
