Search papers, labs, and topics across Lattice.
This paper introduces a three-step hierarchical Transformer designed for multi-pedestrian trajectory prediction, addressing the challenges of temporal dynamics, multimodal cues, and social interactions in crowded environments. By separating temporal encoding, multimodal fusion, and scene-level interaction reasoning, the model improves scalability and interpretability while maintaining efficiency through lightweight GRU summaries and social attention mechanisms. Experimental results demonstrate state-of-the-art performance on real-world datasets like JRDB and Urban, with ablation studies validating the significance of each model component in predicting complex pedestrian behaviors.
A novel three-step hierarchical Transformer achieves state-of-the-art trajectory prediction by efficiently modeling social interactions and multimodal cues without compromising interpretability.
Pedestrian trajectory prediction requires modeling temporal dynamics, multimodal cues, and social interactions in crowded environments. Existing methods often address these factors separately or entangle them in costly attention blocks, limiting scalability, flexibility, and interpretability. We propose a three-step hierarchical Transformer that explicitly separates temporal encoding, multimodal fusion, and scene-level interaction reasoning. Lightweight GRU summaries enable efficient cross-modal attention, while social attention over time--agent tokens captures inter-pedestrian influences at manageable cost. Experiments on JTA, JRDB, and the Pedestrians and Cyclists in Road Traffic dataset show state-of-the-art performance on real-world datasets (JRDB, Urban) and competitive results on JTA. Ablation and qualitative analyses confirm the contribution of each stage and the model's ability to anticipate complex behaviors such as early turning.
