Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces Continuous Quaternion Flows (CQF) for recovering 3D human meshes from a single 2D image, addressing the limitations of existing methods that often yield implausible poses. By leveraging quaternion-constrained continuous normalizing flows conditioned on 2D pose estimations, the authors achieve significant improvements in pose accuracy and plausibility, particularly in ambiguous scenarios. Experimental results on the Human3.6M dataset demonstrate state-of-the-art performance, while also showing competitive results on the challenging 3DPW and EMDB benchmarks.
Quaternion-constrained flows yield more plausible 3D human poses from 2D images, outperforming traditional methods in ambiguous contexts.
Recovering 3D digital humans from a single 2D image is an ill-posed computer vision problem due to the loss of depth information. Probabilistic 3D human pose estimation compensates for this by estimating a set of 3D hypotheses from a prior distribution via generative models. However, most prior work focuses only on 3D keypoints, which often leads to implausible poses that are difficult to apply to downstream tasks, e.g. animation or digital humans. SMPL-based methods are more scalable thanks to the explicit body priors, but it requires more complex modeling of the generation process due to the non-additive nature of the joint rotations. In this work, we propose a novel approach for probabilistic 3D humans using quaternion-constrained continuous normalizing flows conditioned on 2D pose estimations. Our proposed quaternion flows show significant advantages over approaches using other rotation representations. Experiments demonstrate state-of-the-art results of our method on Human3.6M, particularly in ambiguous settings, and comparable pose estimation accuracy on challenging 3DPW and EMDB benchmarks.