Search papers, labs, and topics across Lattice.
This paper introduces ContextMaster, a unified model designed for interactive multi-shot video creation (IMVC), which integrates generation, reference conditioning, and editing while maintaining a shared context history. By employing a role-aware context representation and a two-stage privileged context distillation framework, ContextMaster effectively manages context access and inference efficiency, achieving improved task fulfillment and consistency across multiple shots. Experimental results indicate that ContextMaster outperforms specialized baselines and maintains a high processing speed of 16 FPS on a single GPU, making it a practical solution for complex video tasks.
ContextMaster achieves unprecedented consistency in multi-shot video creation, outperforming specialized models while processing at 16 FPS on a single GPU.
Recent video models increasingly support generation, reference conditioning, and editing within a single model, yet typically expose them as separate operations over fixed inputs. Practical creation unfolds across multiple shots, requiring one model to generate from text, follow a reference, or edit source footage while maintaining shared history. We formalize this setting as interactive multi-shot video creation (IMVC) and introduce ContextMaster, a unified model with a role-aware context representation for these operations. An interactive model must retain access to an expanding history without allowing the context read cost at each denoising step to grow. ContextMaster combines reusable clean context states with fixed budget sparse context routing and uses ConstraintSink to keep task constraints visible. To address the dual challenges of sparse context access and inference with few denoising steps, we propose a two-stage privileged context distillation framework, which transfers full context behavior from a dense teacher through consistency distillation and then refines deployment rollouts with distribution matching. Experiments on the three primitive tasks demonstrate improved task fulfillment and consistency across shots over specialized baselines. User studies further validate flexibly composed workflows, while the model reaches 16 FPS on a single GPU.
Tsinghua AI