Search papers, labs, and topics across Lattice.
This paper introduces Change and Invariance Motion Editing (CIME), a novel framework for text-driven human motion editing that effectively balances the need for change in motion sequences with the preservation of structural consistency. By decoupling spatial poses and temporal rhythms, CIME employs an omni-supervised learning mechanism and a Riemannian Non-uniform Integral Manifold Mapping (RNIMM) module to enhance the fidelity of motion edits while adhering to natural language instructions. Experimental results on the MotionFix and STANCE Adjustment datasets show that CIME outperforms existing methods in both editing alignment and structural fidelity, marking a significant advancement in the field.
Achieving state-of-the-art editing fidelity, CIME seamlessly balances motion change with structural consistency, revolutionizing text-driven human motion editing.
Text-driven human motion editing aims to modify existing motion sequences according to natural language instructions while maintaining the structural consistency of the original motion. Existing diffusion-based approaches struggle to balance text-responsive "change" and inertial "invariance". They often rely on coarse spatial constraints and rigid uniform time assumptions, leading to spatial motion distortions and the destruction of intrinsic physical rhythms during variable-length editing. To handle these challenges, we propose Change and Invariance Motion Editing (CIME), a unified framework that comprehensively decouples change and invariance into spatial pose and temporal rhythm dimensions. For spatial poses, our method integrates an omni-supervised positive-negative learning mechanism comprising hierarchical retrospective feature supervision, subtle motion preservation, and triplet-based semantic alignment. For temporal rhythms, we introduce the Riemannian Non-uniform Integral Manifold Mapping (RNIMM) module, which achieves high-fidelity reproduction of physical beats in the edited text via kinematics-aware non-uniform timestamps. Extensive experiments on the MotionFix and STANCE Adjustment datasets demonstrate that CIME achieves state-of-the-art performance in editing alignment and structural fidelity, validating the effectiveness of our unified architecture. Our source codes and models have been released at: github.com/ZhenwuShi/CIME.git
