Search papers, labs, and topics across Lattice.
This paper introduces ARMS, a novel framework for generating continuous and coherent human motion that effectively handles transitions between solo actions and social interactions. By employing a dynamics-asymmetric representation and a causal relational diffusion model, ARMS allows for seamless switching between solo and interaction modes while maintaining stability and spatial consistency. Experimental results demonstrate that ARMS significantly enhances transition smoothness and social coherence compared to existing methods, while also performing competitively on benchmarks for human-human interactions.
ARMS achieves unprecedented smoothness in motion transitions, enabling realistic solo-to-social interactions without sacrificing coherence or stability.
Generating temporally continuous and socially coherent human motion from text remains a fundamental challenge, particularly in realistic streams where people act alone, enter interactions, and later disengage. Most existing methods generate fixed-length motion clips under static agent configurations, which makes them brittle to solo-social transitions and unsuitable for incremental generation over long horizons. We propose ARMS, an Anchor-Relational Motion Streaming framework that unifies solo motion and human-human interaction within a single causal generative process. ARMS introduces a dynamics-asymmetric representation that decouples per-person temporal evolution from inter-person alignment via a partner-referenced relative-translation term, enabling seamless switching of social coupling without sacrificing long-horizon stability or spatial consistency between agents. On top of a causal latent space, a causal relational diffusion model progressively refines motion segment by segment using only past context, capturing both intra-person temporal dependencies and inter-person relations. Mode-aware relational gating activates or masks cross-agent connections, allowing the same model to support both solo and interaction generation. Experiments show that ARMS improves transition smoothness and social coherence compared to interaction-centric baselines, while also achieving competitive results on human-human interaction benchmarks.