Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces Velox, a training-free attention routing mechanism for video world models that addresses the quadratic scaling of KV caches in chunked diffusion models by employing spatial memory. Velox leverages streaming geometry to select relevant historical context via frustum slab correspondences, achieving significant speedups in attention and denoising. The method maintains performance close to dense models on a challenging navigation benchmark, demonstrating its efficacy in enabling responsive interactive video simulation.
Spatial memory via frustum slab routing slashes video world model inference time by over 4x without sacrificing generation quality.
Video world models turn actions and camera motion into long visual rollouts, making video a natural interface for interactive simulation. Such interaction requires responsive generation, yet coherent rollouts must retain visual memory of what has already been generated. Chunked video diffusion models usually keep this context in growing KV caches, so later chunks become progressively slower. To address this bottleneck, we introduce Velox, a training-free attention router for region-level context selection using frustum slab correspondences from streaming geometry. Velox represents historical blocks as camera frustum slabs with depth intervals and obtains current-block depth through recency-priority multiwarp. For well-covered regions, frustum slab overlap softly modulates each layer's model-derived block importance. Uncovered regions retain the model-derived route without geometric bias. The fixed token-block granularity matches FlashAttention-style tiled execution and reduces the attention term that grows with rollout length. Frustum slab construction runs asynchronously with denoising on the same H200. At chunk 48, Velox accelerates attention by 4.36times and denoising by 2.43times. On the full 158-case WBench navigation split, it remains within 0.15 API-free average points of dense LingBot-Fast-Cam. Please see our project page at https://velox-world.com/velox/ for more details.