Search papers, labs, and topics across Lattice.
This paper introduces ProPose, a comprehensive benchmark for Human Pose Estimation (HPE) that addresses the representation bias in existing datasets by unifying the topological representation of biological limbs, prostheses, and residual limbs. To tackle the scarcity of real-world prosthetic images, a Real-to-Synthetic data expansion pipeline is employed, which enhances the dataset by synthesizing underrepresented cases. The authors also propose ProLoss, a structure-aware objective that improves the accuracy of keypoint predictions for prosthetic joints by enforcing dependencies among keypoints, resulting in a 2% to 6% increase in classification accuracy without sacrificing localization performance.
ProPose not only bridges the gap in pose estimation for diverse limb types but also enhances accuracy for long-tail prosthetic joints through innovative structure-aware loss functions.
Driven by the availability of large-scale datasets, Human Pose Estimation (HPE) plays a critical role in numerous downstream tasks. However, mainstream benchmarks exhibit severe representation bias, predominantly featuring able-bodied individuals. While a few pioneering datasets have attempted to address limb differences, their annotation protocols fail to generalize, struggling to represent specialized mechanical structures like running blades or unprosthetized residual limbs. To bridge this gap, we introduce ProPose, a large-scale benchmark featuring a novel annotation protocol that unifies the topological representation of biological limbs, diverse prostheses, and physical absences within a single framework. Because real-world prosthetic images are inherently scarce and exhibit extreme long-tail distributions, we design a Real-to-Synthetic data expansion pipeline to explicitly synthesize and expand the underrepresented cases. However, simply training existing models on this enriched dataset often leads to suboptimal solutions, as they estimate each keypoint independently and might hallucinate non-existent joints on mechanical structures. To resolve this, we propose ProLoss, a structure-aware objective that enforces keypoint dependencies within a single limb to prevent unrealistic limb predictions. Extensive experiments demonstrate that our approach improves the classification accuracy of long-tail prosthetic joints by 2% to 6% without compromising spatial coordinate localization performance. This work sets a foundation for inclusive pose estimation, unlocking new possibilities for understanding the interactions between human bodies and assistive devices.
