Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces 4LC, a 4D latent cache designed to efficiently condition dynamic world models for video generation by reusing static and dynamic visual representations. By employing composite visual representations from multiple encoders and a flexible spatiotemporal access interface, 4LC avoids costly per-request rendering and re-encoding, enabling rich descriptions of dynamic scenes. The proposed 4LC-Video system demonstrates efficient condition acquisition, enhanced spatiotemporal controllability, and improved scene consistency across various video generation tasks without task-specific fine-tuning.
A single latent cache can unify diverse visual representations and spatiotemporal queries for efficient, consistent dynamic world modeling across multiple video generation tasks.
For video generation in dynamic world modeling, observed static and dynamic content should be efficiently reused to provide conditions for repeated generation at different times and viewpoints. We introduce 4LC, a 4D latent cache with composite visual representations and a flexible spatiotemporal access interface. As a latent cache, 4LC directly reuses visual representations of static and dynamic content to provide generation conditions, avoiding per-request RGB rendering and re-encoding. As a composite cache, 4LC binds visual representations from multiple visual encoders (e.g., VAE, DINO, V-JEPA, VGGT) to shared geometry and motion, allowing the composite representations to describe the dynamic world with rich information. Besides, we design a flexible spatiotemporal interface, which directly reads the cache at independently specified times and viewpoints and combines readouts across observations, providing a common conditioning format for diverse downstream tasks. Building on 4LC, we develop 4LC-Video to address multiple video generation tasks through different configurations of source observations, spatiotemporal requests, and historical reuse, including camera control, temporal control, novel-view synthesis, scene revisits, and long-term generation. Our experiments show more efficient condition acquisition, effective spatiotemporal controllability, and scene consistency across tasks using a single 4LC-Video model without task-specific fine-tuning.