Search papers, labs, and topics across Lattice.
Tsinghua AIKling TeamKuaishouNJUShanghaiTechvivo BlueImage Labvivo Mobile Commu- nication CoJun 1, 2026arXiv:2606.02436This paper introduces GIM-World, a geometry-aware implicit memory framework designed to enhance video world models by effectively compressing variable-length history into fixed-size memory tokens while preserving 3D scene structure. The approach utilizes a lightweight transformer encoder and a camera-queryable geometry head to distill geometric information during training, while an information-guided pruning rule manages encoding costs as the memory grows. Experimental results on the MIND dataset demonstrate that GIM-World outperforms both explicit and implicit memory baselines in maintaining long-horizon geometric and visual consistency.
GIM-World achieves superior long-horizon visual consistency by integrating geometry-aware implicit memory, outperforming traditional memory systems.
Video world models aim to simulate controllable visual environments, but long-horizon rollouts depend on what the model remembers after observations leave its native context window. Explicit memories retain frames or online 3D reconstructions, which can suffer from heuristic retrieval errors, redundant appearance storage, or reconstruction artifacts. Implicit memories compress history into a compact state, but existing designs are not explicitly constrained to encode cross-view scene geometry. We propose GIM-World, a geometry-aware implicit memory framework for video world models. A lightweight transformer encoder compresses variable-length history into fixed-size memory tokens, a camera-queryable geometry head distills 3D scene structure from a frozen foundation model into the memory during training, and an information-guided pruning rule keeps encoding cost bounded as history grows. The geometry teacher is discarded at inference, leaving a lightweight memory module. Experiments on MIND show that GIM-World better preserves long-horizon geometric and visual consistency than both explicit- and implicit-memory baselines.
