Search papers, labs, and topics across Lattice.
This paper introduces PO-PDDL, a symbolic formulation of Partially Observable Markov Decision Processes (POMDPs) that integrates the relational structure of Planning Domain Definition Language (PDDL) while addressing challenges of partial observability and stochastic action execution in robotics. The authors develop a demonstration-driven pipeline that learns PO-PDDL models from real-robot execution videos, reconstructing symbolic state trajectories and identifying inconsistencies to model uncertainty effectively. Experimental results demonstrate that PO-PDDL significantly outperforms existing PDDL and POMDP approaches in long-horizon manipulation tasks, achieving robust planning with lower costs.
Learning symbolic POMDPs from visual demonstrations allows robots to plan effectively under uncertainty, outperforming traditional methods in complex tasks.
Real-world robot task planning must operate under both stochastic action execution and partial observability, yet constructing Partially Observable Markov Decision Process (POMDP) models for real robotics domains remains difficult and labor-intensive. We introduce PO-PDDL, a symbolic formulation of POMDPs that preserves the relational structure and LLM-friendly syntax of the Planning Domain Definition Language (PDDL), while explicitly modeling partial observability, stochasticity, and beliefs. Building on this formulation, we propose a demonstration-driven pipeline for learning PO-PDDL models. The proposed method reconstructs latent symbolic state trajectories from real-robot execution videos, identifies partial observability via inconsistencies between inferred states and visual observations, and learns stochastic transition and observation models accordingly. The resulting PO-PDDL domains are reusable across tasks and enable online belief-space planning under both perception and execution uncertainty. Experiments on real-world long-horizon manipulation tasks show that our method consistently outperforms existing PDDL and POMDP model-learning approaches, achieving robust task planning under uncertainty with significantly lower planning cost.
