Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
BLARM is a novel feed-forward method that animates 3D meshes from monocular video by predicting temporally coherent animations based on learned rigid motion components and skinning weights. This approach eliminates the need for traditional rigging techniques, allowing for a more compact and interpretable deformation space. The method achieves high accuracy and temporal stability in animations while effectively capturing motion structure, demonstrating its potential for practical applications in 3D animation and computer vision.
Achieving accurate 3D mesh animations from video without traditional rigging, BLARM reveals a compact and interpretable motion structure that could revolutionize animation workflows.
We introduce BLARM, a feed-forward method for video-driven 3D mesh animation. Given a monocular video and a static object mesh, BLARM predicts a temporally coherent animated mesh whose motion follows the video. Rather than relying on explicit rigs or directly regressing high-dimensional vertex motion, we represent animation using a compact set of learned, time-varying rigid motion components and time-invariant vertex-to-component skinning weights. This yields a low-dimensional deformation space without requiring skeletons, cages, skinning weights, or rig annotations. Our architecture conditions geometry-derived deformation latents on video features through factorized spatial-temporal attention, then decodes rigid transformations blended by predicted skinning weights. Trained with trajectory reconstruction, entropy regularization, and motion-aware contrastive learning, BLARM produces accurate and temporally stable animations while recovering compact, interpretable motion structure from monocular video.