Search papers, labs, and topics across Lattice.
This paper introduces Looped World Models (LoopWM), a novel architecture designed to address the trade-off between computational depth and simulation fidelity in world modeling. By employing a parameter-shared transformer block to iteratively refine latent environment states, LoopWM achieves up to 100x parameter efficiency compared to traditional models while adapting computation depth based on prediction complexity. This innovative approach establishes iterative latent depth as a new scaling axis, potentially transforming the landscape of long-horizon simulations in AI research.
Achieving 100x parameter efficiency, LoopWM redefines how we approach long-horizon world modeling by introducing iterative latent depth as a new scaling axis.
Current world models face a fundamental tension: faithful long-horizon simulation demands deep computation, but deeper models are expensive to deploy and prone to compounding errors. We resolve this by introducing Looped World Models (LoopWM), which are the first looped architectures for world modelling. Our method iteratively refines latent environment states through a parameter-shared transformer block. This yield up to 100x parameter efficiency over conventional approaches with adaptive computation that automatically scales depth to match the complexity of each prediction step. Orthogonal to scaling model size and training data, LoopWM establishes iterative latent depth as a new scaling axis for world simulation, which might significantly push the community forward.
