Search papers, labs, and topics across Lattice.
SimpliHuMoN, a transformer-based model, tackles human motion prediction by using self-attention to capture spatial pose dependencies and temporal motion relationships. This streamlined, end-to-end model handles pose-only, trajectory-only, and combined prediction tasks without modification. The model achieves state-of-the-art results across Human3.6M, AMASS, ETH-UCY, and 3DPW datasets, outperforming specialized models.
A surprisingly simple transformer architecture beats specialized models on established human motion prediction benchmarks, unifying pose and trajectory forecasting.
Human motion prediction combines the tasks of trajectory forecasting and human pose prediction. For each of the two tasks, specialized models have been developed. Combining these models for holistic human motion prediction is non-trivial, and recent methods have struggled to compete on established benchmarks for individual tasks. To address this, we propose a simple yet effective transformer-based model for human motion prediction. The model employs a stack of self-attention modules to effectively capture both spatial dependencies within a pose and temporal relationships across a motion sequence. This simple, streamlined, end-to-end model is sufficiently versatile to handle pose-only, trajectory-only, and combined prediction tasks without task-specific modifications. We demonstrate that this approach achieves state-of-the-art results across all tasks through extensive experiments on a wide range of benchmark datasets, including Human3.6M, AMASS, ETH-UCY, and 3DPW.
