Search papers, labs, and topics across Lattice.
This paper introduces Motion4Motion, a novel training-free framework for motion transfer that bypasses the limitations of skeleton-based models, enabling the transfer of motion across diverse character types, including animals. By modeling the motion flow directly from video data rather than relying on predefined skeleton structures, the approach significantly enhances generalization capabilities and preserves unique motion styles. Experimental results demonstrate that Motion4Motion outperforms existing baselines, showcasing its potential for broader applications in digital animation and character design.
Motion4Motion revolutionizes motion transfer by eliminating the need for skeletons, allowing seamless animation across diverse species and character types.
This work explores the motion transfer from one video to another, which is crucial in animation for diverse characters. Previously, video motion transfer has been largely explored between human and human-like characters, enabling a lot of applications in digital creation. However, these approaches encounter a main limitation. Specifically, related technical pipelines heavily rely on a predefined human skeleton structure and accordingly require skeleton-conditional model training. On the one hand, these methods are difficult to generalize to diverse characters, such as animals from different species, while preserving their unique motion styles. On the other hand, labeled data in diverse skeletons is limited, which additionally restricts the large-scale training for the task. In this paper, we jump out of the skeleton-based motion transfer framework and propose a training-free motion transfer framework, named Motion4Motion. Motion4Motionmodels the motion flow of the character in a video instead of skeletons, which makes motion transfer across species easier. Extensive experimental results and novel applications show our methods outperform baselines impressively. Project page is available at https://lhchen.top/Motion4Motion.
Tsinghua AI