Search papers, labs, and topics across Lattice.
This paper introduces iCrowdNav, a novel approach to robot crowd navigation that utilizes intention-aware scene representations to enhance the understanding of human behaviors in complex environments. By employing a spatio-temporal encoder and an attention-based module called Intent-Interact Former (I虏 Former), the method effectively captures both occupancy features and human motion intentions from egocentric visual inputs. Experimental results indicate that iCrowdNav significantly outperforms existing methods, demonstrating its practical applicability in real-world crowd navigation scenarios.
Robots can now navigate crowded spaces more effectively by understanding human intentions, thanks to a new method that integrates rich visual cues into their decision-making process.
Robot crowd navigation requires the ability to infer human intentions while accounting for the structural constraints of the environment. Currently, deep reinforcement learning (DRL) provides a promising method for learning navigation policies that understand human intentions. However, most of them rely on limited scene representations, treating pedestrians as simple 2D points and ignoring rich visual cues from both humans and the environment. To address this issue, we introduce iCrowdNav, a novel visual crowd navigation method with intention-aware scene representations, to encode behavioral and structural context from egocentric visual observations. Our method employs two key components: a spatio-temporal encoder for extracting occupancy features of the scene, and Intent-Interact Former (I$^2$ Former), an attention-based module that encodes human poses to infer pedestrians' motion intentions. These features are integrated into a compact state embedding that supports effective DRL policy training. Extensive experiments show that our method achieves superior performance over baselines, and real-world deployment demonstrates vision-based crowd navigation.
Microsoft Research