Search papers, labs, and topics across Lattice.
The authors introduce OpenT2M, a large-scale (million-level), high-quality, open-source motion dataset containing over 2800 hours of human motion with detailed text annotations, designed to address the limitations of existing T2M datasets. They also propose MonoFrill, a T2M model leveraging a novel 2D-PRQ motion tokenizer that captures spatiotemporal dependencies by dividing the human body into biological parts. Experiments demonstrate that OpenT2M improves the generalization of existing T2M models, and MonoFrill achieves strong zero-shot performance.
A million-sequence, high-quality, open-source motion dataset finally lets text-to-motion models generalize beyond toy benchmarks.
Text-to-motion (T2M) generation aims to create realistic human movements from text descriptions, with promising applications in animation and robotics. Despite recent progress, current T2M models perform poorly on unseen text descriptions due to the small scale and limited diversity of existing motion datasets. To address this problem, we introduce OpenT2M, a million-level, high-quality, and open-source motion dataset containing over 2800 hours of human motion. Each sequence undergoes rigorous quality control through physical feasibility validation and multi-granularity filtering, with detailed second-wise text annotations. We also develop an automated pipeline for creating long-horizon sequences, enabling complex motion generation. Building upon OpenT2M, we introduce MonoFrill, a pretrained motion model that achieves compelling T2M results without complicated designs or technique tricks as"frills". Its core component is 2D-PRQ, a novel motion tokenizer that captures spatiotemporal dependencies by dividing the human body into biology parts. Experiments show that OpenT2M significantly improves generalization of existing T2M models, while 2D-PRQ achieves superior reconstruction and strong zero-shot performance. We expect OpenT2M and MonoFrill will advance the T2M field by addressing longstanding data quality and benchmarking challenges.
