Search papers, labs, and topics across Lattice.
DancingBox is introduced as a lightweight, vision-based motion capture system that uses everyday objects as proxies for character animation. A generative motion model, conditioned on bounding-box representations of these proxies and human motion priors, refines the coarse proxy motions into realistic animations. The system is trained on synthesized proxy-animation pairs generated by converting existing motion capture data into proxy representations.
Animate 3D characters using bananas and plush toys – DancingBox turns everyday objects into motion capture proxies, making animation accessible to novices.
Creating compelling 3D character animations typically requires either expert use of professional software or expensive motion capture systems operated by skilled actors. We present DancingBox, a lightweight, vision-based system that makes motion capture accessible to novices by reimagining the process as digital puppetry. Instead of tracking precise human motions, DancingBox captures the approximate movements of everyday objects manipulated by users with a single webcam. These coarse proxy motions are then refined into realistic character animations by conditioning a generative motion model on bounding-box representations, enriched with human motion priors learned from large-scale datasets. To overcome the lack of paired proxy-animation data, we synthesize training pairs by converting existing motion capture sequences into proxy representations. A user study demonstrates that DancingBox enables intuitive and creative character animation using diverse proxies, from plush toys to bananas, lowering the barrier to entry for novice animators.
Tsinghua AI