Search papers, labs, and topics across Lattice.
OctWorld introduces a video diffusion framework that utilizes persistent 3D memory for generating high-fidelity, explorable visual scenes from a single image along user-defined camera trajectories. The core innovation is OctMap, a spatially adaptive 3D memory system that fuses visual observations and depth maps into a global representation, enabling stable long-range video generation while preserving spatial consistency. Experimental results show that OctWorld significantly outperforms existing methods in generating long-range, coherent videos, demonstrating its effectiveness in complex scene settings.
OctWorld achieves unprecedented long-range video generation with spatial consistency, outperforming traditional methods by leveraging an innovative 3D memory architecture.
We present OctWorld, a video diffusion framework with persistent 3D memory for generating explorable, world-consistent, and high-fidelity visual scenes. Given a single image, OctWorld performs stable autoregressive world generation along user-specified camera trajectories. We focus on long-range generation, characterized by extended camera paths and wide viewpoint coverage, where preserving spatial consistency is particularly challenging when previously generated regions are revisited. To address this problem, we introduce OctMap, an extensible and spatially adaptive 3D memory that progressively fuses generated visual observations and their corresponding depth maps into a global representation. OctMap employs TSDF fusion within a dynamic sparse octree whose spatial resolution adapts to image evidence. This design preserves geometric and appearance details across diverse scene scales while maintaining low memory overhead. Experiments demonstrate that OctWorld generates long-range, spatially consistent videos and outperforms prior methods on both existing benchmarks and challenging long-range generation settings. OctMap also provides clear advantages over point-based caches and fixed-resolution TSDF volumes. Project page: https://maxtirerror.github.io/octworldpage/
