Search papers, labs, and topics across Lattice.
Manga2Animate addresses the challenge of faithful manga-to-animation adaptation by employing a multi-agent framework that grounds generation in source manga panels. The system decomposes the task into animation script and visual storyboard generation, with creator and reviewer agents iteratively refining these intermediate representations through tailored feedback mechanisms. Experiments and user studies confirm Manga2Animate's superior faithfulness and shot consistency compared to existing methods.
A novel agentic framework achieves high-fidelity manga animation by grounding generation in source panels through iterative script and storyboard refinement.
Adapting existing manga into coherent animation that stays faithful to the source is a valuable yet challenging task. Existing methods either access the manga mainly through text, losing its characters and art style, or feed manga pages directly into video generation models, which misinterpret the manga's structure and produce incorrect storylines. In this paper, we propose Manga2Animate, a multi-agent framework that grounds every stage of generation in the source manga. We decompose the task into two intermediate representations, an animation script and a visual storyboard. Each representation is produced by a creator agent and reviewed against the source panels by a paired reviewer agent. We tailor representation-specific selection and dual-level feedback to progressively refine both before synthesizing the final animation. Extensive experiments and a user study demonstrate that Manga2Animate produces animations more faithful to the source manga and more consistent across shots than state-of-the-art approaches. Project page: https://annchenn.github.io/Manga2Animate/