Search papers, labs, and topics across Lattice.
This paper introduces Spherical Latent Motion Prior (SLMP), a two-stage method for learning motion priors for physics-based humanoid control that addresses limitations of VAE and AMP approaches. SLMP first trains a high-quality motion tracking controller, then distills it into a spherical latent space using a combination of distillation, a discriminator, and a discriminator-guided local semantic consistency constraint. Experiments on a new two-hour human combat motion capture dataset demonstrate that SLMP preserves fine motion detail, enables stable random sampling of semantically valid behaviors, and generalizes across different humanoid morphologies in a two-agent combat task.
Ditch VAEs and AMP: SLMP learns structured motion priors in a spherical latent space, enabling stable random sampling of diverse and valid humanoid behaviors without information loss.
Learning motion priors for physics-based humanoid control is an active research topic. Existing approaches mainly include variational autoencoders (VAE) and adversarial motion priors (AMP). VAE introduces information loss, and random latent sampling may sometimes produce invalid behaviors. AMP suffers from mode collapse and struggles to capture diverse motion skills. We present the Spherical Latent Motion Prior (SLMP), a two-stage method for learning motion priors. In the first stage, we train a high-quality motion tracking controller. In the second stage, we distill the tracking controller into a spherical latent space. A combination of distillation, a discriminator, and a discriminator-guided local semantic consistency constraint shapes a structured latent action space, allowing stable random sampling without information loss. To evaluate SLMP, we collect a two-hour human combat motion capture dataset and show that SLMP preserves fine motion detail without information loss, and random sampling yields semantically valid and stable behaviors. When applied to a two-agent physics-based combat task, SLMP produces human-like and physically plausible combat behaviors only using simple rule-based rewards. Furthermore, SLMP generalizes across different humanoid robot morphologies, demonstrating its transferability beyond a single simulated avatar.
