Search papers, labs, and topics across Lattice.
The paper introduces HSTGFormer, a novel graph-enhanced Transformer framework designed for monocular 3D human pose estimation that effectively integrates spatial and temporal reasoning by utilizing a Hyper Spatial-Temporal Graph (HSTG). This approach allows for localized coupled graph aggregation around joint-time nodes, preserving critical structural motion information while enabling efficient reasoning. Experimental results on benchmark datasets Human3.6M and MPI-INF-3DHP demonstrate that HSTGFormer achieves superior accuracy and computational efficiency compared to existing methods.
By reformulating spatial-temporal reasoning into localized coupled graph aggregation, HSTGFormer significantly enhances 3D human pose estimation accuracy while maintaining computational efficiency.
Transformer-based methods have achieved strong performance in monocular 3D human pose estimation, but most existing approaches organise spatial and temporal reasoning as separate stages, which may weaken unified spatial-temporal interdependencies inherent in human motion and compress frame-level structural information before temporal modelling. In this paper, we propose HSTGFormer, a graph-enhanced Transformer framework that reformulates spatial-temporal reasoning as localised coupled graph aggregation over joint-time nodes. Specifically, HSTGFormer introduces a Hyper Spatial-Temporal Graph (HSTG), which decomposes global spatial-temporal reasoning into local spatial-temporal receptive fields around individual joint-time nodes by extending per-frame skeleton graphs into temporal neighbourhoods, thereby enabling structure-aware coupled reasoning while preserving local structural motion information. It further incorporates an Adaptive Dual-Scale Temporal Graph (ADSTG) to capture joint-specific temporal dependencies over complementary short- and long-range windows. A lightweight node-wise fusion module further adaptively integrates the two graph representations for each joint-time node. Experiments on Human3.6M and MPI-INF-3DHP show that HSTGFormer achieves strong accuracy with high computational efficiency.
