Search papers, labs, and topics across Lattice.
This paper introduces a neurosymbolic world model that decouples observation reconstruction from reward prediction, enabling zero-shot adaptation to new tasks without additional environment interactions. By leveraging structured symbolic components within the latent state, the model enhances generalization capabilities compared to traditional task-dependent neural world models. The results show significant improvements in task transferability, highlighting the potential for more interpretable and adaptable reinforcement learning systems.
Zero-shot adaptation to new tasks is now feasible with neurosymbolic world models that leverage structured symbolic components for reward prediction.
State-of-the-art model-based reinforcement learning methods learn neural world models that allow policy improvement by planning in a latent space, without assumptions on the structure of the underlying environment. While expressive, these models are generally task-dependent: they learn uninterpretable latent representations that are tied to the training task and thus hard to generalize to new tasks. In this work, we present a novel world model formulation where the reward prediction only depends on a subset of structured, symbolic components of the whole latent state. Decoupling observation reconstruction and reward prediction allows us to learn world models that can adapt zero-shot, i.e. without further environment interactions, to new reward functions defined over the same symbolic state space. We discuss the main advantages and challenges of learning these neurosymbolic world models and demonstrate the strong generalisation properties of our approach over purely neural methods.
