Search papers, labs, and topics across Lattice.
The paper introduces Discrete World Models via Regularization (DWMR), a novel reconstruction-free and contrastive-free method for unsupervised learning of Boolean world models. DWMR employs a world-modeling loss that couples latent prediction with regularizers designed to maximize entropy and independence of representation bits while enforcing a locality prior for sparse action changes. Experiments on benchmarks with combinatorial structure demonstrate that DWMR learns more accurate representations and transitions compared to reconstruction-based methods, and benefits from an auxiliary reconstruction decoder.
Ditch the decoder: DWMR learns surprisingly accurate and interpretable Boolean world models using only regularization, outperforming reconstruction-based methods on combinatorial tasks.
World models aim to capture the states and dynamics of an environment in a compact latent space. Moreover, using Boolean state representations is particularly useful for search heuristics and symbolic reasoning and planning. Existing approaches keep latents informative via decoder-based reconstruction, or instead via contrastive or reward signals. In this work, we introduce Discrete World Models via Regularization (DWMR): a reconstruction-free and contrastive-free method for unsupervised Boolean world-model learning. In particular, we introduce a novel world-modeling loss that couples latent prediction with specialized regularizers. Such regularizers maximize the entropy and independence of the representation bits through variance, correlation, and coskewness penalties, while simultaneously enforcing a locality prior for sparse action changes. To enable effective optimization, we also introduce a novel training scheme improving robustness to discrete roll-outs. Experiments on two benchmarks with underlying combinatorial structure show that DWMR learns more accurate representations and transitions than reconstruction-based alternatives. Finally, DWMR can also be paired with an auxiliary reconstruction decoder, and this combination yields additional gains.
