Search papers, labs, and topics across Lattice.
WorldDirector introduces a novel video world model framework that separates semantic motion orchestration from visual generation, allowing for persistent dynamic memory and flexible viewpoint exploration. This decoupling enables the framework to maintain strict physical logic and visual consistency, even for dynamic entities that leave and re-enter the scene. Experimental results highlight its capability to synthesize complex events with a level of controllability previously unattainable in existing models.
WorldDirector achieves unprecedented control over dynamic object memory in video synthesis, ensuring visual consistency even after prolonged occlusion.
We present WorldDirector, a highly controllable video world model framework designed for persistent dynamic object memory and unrestricted viewpoint exploration. Unlike existing world models that entangle physical dynamics with pixel rendering and rely on continuous visual observation to sustain motion, our framework explicitly decouples semantic motion orchestration from visual generation. By leveraging an LLM to coordinate 3D trajectories with camera movements and subsequently employing these orchestrated trajectories as control signals for video generation, our approach ensures strict physical logic and appearance stability, successfully preserving the exact visual identities of dynamic entities even when they re-enter the scene after prolonged periods out of view. Experimental results demonstrate that our method supports the synthesis of complex and extended events with unprecedented controllability and persistent dynamic object memory. Project Page: https://worlddirector.github.io/
