Search papers, labs, and topics across Lattice.
This paper introduces MOCHI, a two-stage framework designed to enhance noisy data from collaborative human-object interactions (MHOI) by generating physically plausible hand grasps and refining full-body motion sequences. The method addresses common artifacts in MHOI data, such as contact misalignment and motion jitter, by optimizing hand-object interactions and leveraging diffusion-based noise optimization with single-person motion priors. Experimental results indicate that MOCHI effectively improves the quality of MHOI data across various scenarios, demonstrating its robustness and applicability in keyframe creation and data augmentation.
MOCHI transforms noisy collaborative interaction data into high-fidelity motion sequences, significantly improving the realism and usability of MHOI datasets.
Collaborative human-object interaction shows dynamic and complex movements that require mutual anticipation and continuous adjustment between participants and the shared object. Modeling such collaborative multi-human object interaction (MHOI) scenarios requires high-quality data acquisition as a foundational step; however, this is challenging due to the inherent complexity of MHOI where human-human and human-object interactions occur simultaneously. Such complexity leads to noisy MHOI captures characterized by several artifacts: contact misalignment between hands and objects, motion jitter and temporal inconsistencies in the captured sequences, and missing or incomplete finger-level articulation details. To address these challenges, we present MOCHI (MOtion Enhancement of Collaborative Human-object Interactions), a two-stage framework for enhancing noisy MHOI data. Our approach first generates physically plausible hand grasps through optimization from noisy body input, producing grasps that are both physically plausible and semantically consistent with the body pose, where these optimized grasps are extended into complete hand-object interaction sequences. Consequently, the full-body motion for all participants are refined through a diffusion-based noise optimization framework that uses single-person motion priors. During the optimization process, we introduce optimization objectives to encode human-object and human-human interaction information within these single-person priors. Experimental results demonstrate the effectiveness of our pipeline across diverse MHOI data, either acquired by existing capture methods or synthesized by generative models. We further show robustness of our system across varying numbers of participants and types of interactions, and demonstrate various applications including keyframe-based MHOI creation and data augmentation through varying object geometries.
