Search papers, labs, and topics across Lattice.
This paper introduces a framework for online construction of symbolic causal world models by integrating continuous model learning and repair within an agent's decision loop. The approach leverages Meta-Interpretive Learning and predicate invention to discover semantically meaningful abstractions, enabling the agent to build a hierarchy of disentangled concepts from its observations. Experiments demonstrate superior sample efficiency compared to PPO in complex relational domains where propositional methods struggle.
Agents can learn reusable, high-level causal abstractions from raw experience with orders-of-magnitude greater sample efficiency than neural network baselines, thanks to a new framework combining online model learning, repair, and predicate invention.
Efficiently navigating complex environments requires agents to internalize the underlying logic of their world, yet standard world modelling methods often struggle with sample inefficiency, lack of transparency, and poor scalability. We propose a framework for constructing symbolic causal world models entirely online by integrating continuous model learning and repair into the agent's decision loop, by leveraging the power of Meta-Interpretive Learning and predicate invention to find semantically meaningful and reusable abstractions, allowing an agent to construct a hierarchy of disentangled, high-quality concepts from its observations. We demonstrate that our lifted inference approach scales to domains with complex relational dynamics, where propositional methods suffer from combinatorial explosion, while achieving sample-efficiency orders of magnitude higher than the established PPO neural-network-based baseline.
