Search papers, labs, and topics across Lattice.
This paper introduces CIGPose, a framework for whole-body pose estimation that uses a Structural Causal Model (SCM) to address spurious correlations learned from visual context. CIGPose employs a Causal Intervention Module to identify and replace confounded keypoint representations with context-invariant canonical embeddings, which are then processed by a hierarchical graph neural network. Experiments on COCO-WholeBody demonstrate that CIGPose achieves state-of-the-art performance, reaching 67.0% AP without extra training data and 67.5% AP with the UBody dataset, indicating improved robustness and data efficiency.
By explicitly modeling and mitigating the confounding effects of visual context, CIGPose achieves state-of-the-art whole-body pose estimation, outperforming previous methods even without relying on extra training data.
State-of-the-art whole-body pose estimators often lack robustness, producing anatomically implausible predictions in challenging scenes. We posit this failure stems from spurious correlations learned from visual context, a problem we formalize using a Structural Causal Model (SCM). The SCM identifies visual context as a confounder that creates a non-causal backdoor path, corrupting the model's reasoning. We introduce the Causal Intervention Graph Pose (CIGPose) framework to address this by approximating the true causal effect between visual evidence and pose. The core of CIGPose is a novel Causal Intervention Module: it first identifies confounded keypoint representations via predictive uncertainty and then replaces them with learned, context-invariant canonical embeddings. These deconfounded embeddings are processed by a hierarchical graph neural network that reasons over the human skeleton at both local and global semantic levels to enforce anatomical plausibility. Extensive experiments show CIGPose achieves a new state-of-the-art on COCO-WholeBody. Notably, our CIGPose-x model achieves 67.0\% AP, surpassing prior methods that rely on extra training data. With the additional UBody dataset, CIGPose-x is further boosted to 67.5\% AP, demonstrating superior robustness and data efficiency. The codes and models are publicly available at https://github.com/53mins/CIGPose.
