Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces ReImagine, a human video generation pipeline that leverages an image-first approach to decouple appearance modeling from temporal consistency. It combines a pretrained image backbone with SMPL-X-based motion guidance and a training-free temporal refinement stage using a pretrained video diffusion model. The method achieves high-quality, temporally consistent videos controllable by pose and viewpoint, outperforming existing approaches.
High-fidelity human videos with precise pose and viewpoint control are now possible thanks to a clever image-first synthesis approach that sidesteps the usual appearance/motion entanglement.
Human video generation remains challenging due to the difficulty of jointly modeling human appearance, motion, and camera viewpoint under limited multi-view data. Existing methods often address these factors separately, resulting in limited controllability or reduced visual quality. We revisit this problem from an image-first perspective, where high-quality human appearance is learned via image generation and used as a prior for video synthesis, decoupling appearance modeling from temporal consistency. We propose a pose- and viewpoint-controllable pipeline that combines a pretrained image backbone with SMPL-X-based motion guidance, together with a training-free temporal refinement stage based on a pretrained video diffusion model. Our method produces high-quality, temporally consistent videos under diverse poses and viewpoints. We also release a canonical human dataset and an auxiliary model for compositional human image synthesis. Code and data are publicly available at https://github.com/Taited/ReImagine.