Search papers, labs, and topics across Lattice.
This paper introduces MDP-Net, an end-to-end network designed for estimating 3D human meshes from temporal pressure data collected across multiple devices. By employing a multimodal fusion mechanism inspired by the Mixture of Experts framework, the model enhances the complementarity of cross-device pressure information, overcoming the limitations of single-device monitoring. Experimental results on the newly constructed MDP dataset reveal a joint position error of 12.6 cm, demonstrating the effectiveness of this approach for unobtrusive human pose monitoring.
Fusing pressure data from multiple devices can significantly improve the accuracy of 3D human mesh estimation, achieving a joint position error of just 12.6 cm.
Human pose monitoring is crucial in fields such as rehabilitation assessment and human-computer interaction. Due to its privacy-preserving nature, pressure-based human pose monitoring has become a primary approach for unobtrusive sensing. However, existing methods are generally limited to a single device, which restricts the effective monitoring range. To address this limitation, we propose MDP-Net, an end-to-end network capable of directly estimating human meshes from temporal pressure data across multiple devices. We introduce a multimodal fusion mechanism inspired by the Mixture of Experts (MoE) framework to achieve effective complementarity and enhancement of cross-device pressure information. To support the training and evaluation of MDP-Net, we constructed MDP, a high-quality multi-device temporal pressure dataset that includes various pose labels such as 2D/3D joints and human meshes. Experimental results demonstrate that MDP-Net achieves a joint position error of 12.6 cm on the MDP dataset. These results prove that fusing multi-device pressure information is an effective and promising new solution for daily human pose monitoring.
