Search papers, labs, and topics across Lattice.
To resolve the narrative collapse and continuity failures caused by packing long multi-shot sequences along a single 1D temporal axis, MovieGrid decomposes long videos into sequential temporal chunks tiled across a 2D spatial grid for joint spatio-temporal diffusion modeling. Trained on a 54K-video dataset using noise-free context chunk conditioning and layout-stabilizing boundary losses, the model facilitates global inter-chunk attention without overloading the temporal context window. Under identical token budgets, it delivers 6.05脳 more shots than temporal packing across 1,616 frames while establishing new state-of-the-art metrics for both intra-shot motion (0.9131) and inter-shot narrative consistency (0.5914).
Tiling multi-shot video chunks across a 2D spatial grid instead of stretching them along a single temporal axis yields 6脳 more narrative shots under the exact same token budget while decisively outperforming prior consistency baselines.
Generating long-form multi-shot videos requires coherent within-shot motion and visually consistent narratives across shots. Existing video generators favor continuous motion and struggle to present complete shot sets when an entire narrative is packed along one temporal axis. We propose MovieGrid, a Multi-Grid Post-Training paradigm that decomposes a long video into shorter, temporally ordered chunks and arranges them on a spatial grid for joint modeling. This design reduces the number of shots handled by each temporal axis while enabling global information exchange across chunks. We construct the Multi-Grid Long Video (MGLV) dataset from 1,000 long-form videos using source video collection, hierarchical segmentation, grid video construction, and character-aware story annotation, producing 54K grid videos paired with story prompts. Our Noise-Free Random-Grid Training retains a random subset of chunks as clean visual context for denoising the remaining chunks. Grid Embedding encodes grid structure, character-aware Story Prompts link recurring entities, and Grid Boundary Loss stabilizes layouts. Under the same token budget, MovieGrid generates 6.05 times more shots than Temporal Packing in a 1,616-frame video. On a benchmark spanning five real-world categories, it achieves state-of-the-art intra-shot consistency (0.9131 versus 0.8086 for HoloCine) and inter-shot consistency (0.5914 versus 0.5384 for StoryMem). MovieGrid can further scale video length with minimal compromise through single or multiple generations.
