Search papers, labs, and topics across Lattice.
This paper addresses the challenge of sample inefficiency and state drift in Transformer-based generalized planning by formulating it as a transition model learning problem. They train a neural model to explicitly approximate the successor-state function and generate plans by rolling out symbolic state trajectories, autoregressively predicting intermediate world states. Experiments across multiple domains demonstrate that learning explicit transition models achieves higher out-of-distribution planning success with fewer training instances and smaller models compared to direct action-sequence prediction.
Explicitly learning transition models in generalized planning yields better out-of-distribution performance with fewer samples and smaller models than directly predicting action sequences.
Generalized planning studies the construction of solution strategies that generalize across families of planning problems sharing a common domain model, formally defined by a transition function $\gamma : S \times A \rightarrow S$. Classical approaches achieve such generalization through symbolic abstractions and explicit reasoning over $\gamma$. In contrast, recent Transformer-based planners, such as PlanGPT and Plansformer, largely cast generalized planning as direct action-sequence prediction, bypassing explicit transition modeling. While effective on in-distribution instances, these approaches typically require large datasets and model sizes, and often suffer from state drift in long-horizon settings due to the absence of explicit world-state evolution. In this work, we formulate generalized planning as a transition-model learning problem, in which a neural model explicitly approximates the successor-state function $\hat{\gamma} \approx \gamma$ and generates plans by rolling out symbolic state trajectories. Instead of predicting actions directly, the model autoregressively predicts intermediate world states, thereby learning the domain dynamics as an implicit world model. To study size-invariant generalization and sample efficiency, we systematically evaluate multiple state representations and neural architectures, including relational graph encodings. Our results show that learning explicit transition models yields higher out-of-distribution satisficing-plan success than direct action-sequence prediction in multiple domains, while achieving these gains with significantly fewer training instances and smaller models. This is an extended version of a short paper accepted at ICAPS 2026 under the same title.
