Search papers, labs, and topics across Lattice.
The paper introduces SEAL-pose, a data-driven framework for 3D human pose estimation that uses a learnable loss-net to train a pose-net by evaluating structural plausibility based on joint-graph representations. This approach allows the loss-net to learn complex structural dependencies directly from data, overcoming the limitations of manually designed priors or rule-based constraints. Experiments on multiple 3D HPE benchmarks demonstrate that SEAL-pose reduces per-joint errors and improves pose plausibility compared to various backbones and models with explicit structural constraints.
Ditch the hand-crafted priors: SEAL-pose learns a data-driven loss function that significantly boosts 3D human pose estimation by enforcing structural consistency, outperforming models with explicit constraints.
3D human pose estimation (HPE) is characterized by intricate local and global dependencies among joints. Conventional supervised losses are limited in capturing these correlations because they treat each joint independently. Previous studies have attempted to promote structural consistency through manually designed priors or rule-based constraints; however, these approaches typically require manual specification and are often non-differentiable, limiting their use as end-to-end training objectives. We propose SEAL-pose, a data-driven framework in which a learnable loss-net trains a pose-net by evaluating structural plausibility. Rather than relying on hand-crafted priors, our joint-graph-based design enables the loss-net to learn complex structural dependencies directly from data. Extensive experiments on three 3D HPE benchmarks with eight backbones show that SEAL-pose reduces per-joint errors and improves pose plausibility compared with the corresponding backbones across all settings. Beyond improving each backbone, SEAL-pose also outperforms models with explicit structural constraints, despite not enforcing any such constraints. Finally, we analyze the relationship between the loss-net and structural consistency, and evaluate SEAL-pose in cross-dataset and in-the-wild settings.
