Search papers, labs, and topics across Lattice.
MotionMAR introduces a multi-scale autoregressive framework for reconstructing human motion from sparse observations, leveraging a hierarchical temporal structure. The method employs a Temporal Multi-scale Tokenization VQ-VAE to encode motion data at varying resolutions, followed by a Motion Autoregressive Network that refines the global trajectory into detailed motion sequences. Experimental results demonstrate that MotionMAR achieves state-of-the-art accuracy on the AMASS dataset, highlighting its effectiveness in producing reliable and structure-aware motion reconstructions.
MotionMAR achieves unprecedented accuracy in human motion reconstruction from sparse data by effectively separating global trajectories from fine details.
Human motion follows a temporal hierarchical structure, transitioning from low-frequency global trajectories to high-frequency details. Inspired by the success of multi-level autoregressive models in computer vision, we propose MotionMAR, a coarse-to-fine framework for motion reconstruction from sparse observations. It first estimates the global trajectory of human motion and then gradually refines the temporal details. This architecture consists of four integrated components. The Temporal Multi-scale Tokenization (TMT) VQ-VAE encodes the data at multiple temporal resolutions, separating semantic motion from minor jitters. The Motion Autoregressive Network (MAN) operates in this latent space, predicting motion across scales. It first establishes the global structure through coarse indices and then generates finer indices to recover specific details. Meanwhile, the Scale-Aware Control (SAC) module integrates sparse tracking data to ensure the generated output aligns with actual observations. The Motion Refinement Network (MRN) subsequently smooths consecutive poses and eliminates quantization artifacts. Experiments show that MotionMAR achieves state-of-the-art accuracy on the AMASS dataset, providing a reliable and structure-aware approach for motion reconstruction. The source code is publicly available at http://www.lidarhumanmotion.net/motionmar/.
