Search papers, labs, and topics across Lattice.
This paper addresses the problem of self-intersections in generated 3D human motions, a common artifact that limits the perceived quality despite advancements in motion generation. They introduce a novel self-intersection loss based on a computationally efficient human sphere proxy, achieving significant speed and memory improvements over mesh-based methods. Integrating this loss into existing models like MDM and MoMask reduces self-intersections by up to 49% while also improving other motion quality metrics.
Generated human motions still look janky? This sphere-based self-intersection loss slashes body-part collisions by nearly 50% while actually *improving* overall motion quality.
Human motion generation has made tremendous progress in recent years, with state-of-the-art approaches surpassing ground truth data in leading evaluation benchmarks. However, visual inspection of the generated motions paints a different picture. Even state-of-the-art approaches generate motions frequently containing self-intersections, i.e., body parts interpenetrating, which are strong artifacts, severely limiting the perceived motion quality. We introduce a novel loss, which explicitly penalizes self-intersections, to the training of human motion generation methods. We base our loss on a sphere proxy of human geometry, which allows us to calculate a self-intersection loss 98% faster and uses 83% less memory than comparable methods based on triangular meshes. The loss is agnostic to the specific approach, and we add it to the training of the recent human motion generation methods human motion diffusion model (MDM) and MoMask. Our extensive experiments show a reduction of self-intersections in generated motions of up to 49% while improving other evaluation metrics. The code is available at https://github.com/boschresearch/humansphereproxy .