Search papers, labs, and topics across Lattice.
This study systematically compares three paradigms for training-free multi-subject image-to-video (I2V) generation: direct, parallel, and sequential methods. The evaluation focuses on metrics such as appearance preservation, motion fidelity, temporal consistency, and inter-subject coherence across diverse scenes. Findings indicate that while direct generation synthesizes all subjects jointly, parallel generation simplifies the process at the cost of inter-subject context, and sequential generation maintains scene context but is sensitive to ordering and error propagation.
Direct, parallel, and sequential generation methods reveal distinct strengths and weaknesses in multi-subject video synthesis, with implications for future I2V system designs.
Text-conditioned image-to-video (I2V) generation has advanced rapidly, yet generating videos with multiple subjects remains challenging. A model must simultaneously preserve the appearance of each subject, assign distinct motions, and maintain coherent spatial and temporal interactions. This paper presents a systematic study of three representative paradigms for training-free multi-subject I2V generation: direct, parallel, and sequential generation. Direct generation applies a pretrained I2V model to the complete reference image and prompt, requiring all subjects and motions to be synthesized jointly. Parallel and sequential generation instead decompose the reference image and prompt into subject-specific visual and textual conditions. Parallel generation synthesizes each subject independently and subsequently composes the resulting videos, reducing the complexity of each generation step at the cost of weaker inter-subject context. Sequential generation first synthesizes a background video and then progressively introduces individual subjects. This preserves accumulated scene context but introduces sensitivity to subject ordering and error propagation. We empirically evaluate the three paradigms across diverse multi-subject scenes, comparing appearance preservation, motion fidelity, temporal consistency, and inter-subject coherence, while also characterizing their distinct failure modes. Our findings reveal the strengths and limitations of each paradigm and offer practical insights for designing controllable multi-subject video generation systems.
