Search papers, labs, and topics across Lattice.
This paper introduces HumAIN, a framework that integrates implicit social cues into robot navigation planning through knowledge distillation, enhancing the robot's ability to interpret human behavior. By employing a transformer-based teacher model that processes multi-modal inputs, the approach learns robust representations for trajectory planning, which are then distilled into a lightweight student model for real-time application. The results show a significant improvement in trajectory prediction metrics, with an average increase of 29.8% compared to existing methods, underscoring the effectiveness of using subtle human cues for socially aware navigation.
Robots can now achieve human-like navigation awareness by leveraging subtle social cues, improving trajectory prediction by nearly 30%.
Effective social robot navigation requires sensitivity to human behavior, often revealed through subtle skeletal cues like gait and orientation. We present Human-Aware Implicit Social Robot Navigation (HumAIN), a novel framework that fuses implicit social cues directly into the planning loop via knowledge distillation. We first employ a transformer-based teacher model that fuses rich multi-modal inputs, including historic images, skeletal keypoints, robot state, and a robot's target goal, to learn robust, human-aware representations for the robot's future trajectory planning. To enable real-time deployment, we then distill this knowledge into a lightweight student model. By optimizing for both trajectory reconstruction and latent feature alignment with the teacher, the student learns to infer complex social dynamics from minimal inputs. Bridging the prediction-planning gap with an efficient distilled architecture, our method enables robots to reason about human behavior in a manner that is adaptive, robust, and socially compliant. We validate HumAIN through extensive experiments, where it improves trajectory prediction metrics by an average of 29.8% across all metrics compared to state-of-the-art baselines. These results highlight the benefit of using implicit, whole-body cues to achieve human-like navigation awareness on resource-constrained platforms.
