Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces Online Hypothesis-Driven Conditional Action Model Learning (OHCAM), an innovative online method for learning action models that incorporate conditional and quantified effects using limited environmental interactions. By maintaining a belief over various action model hypotheses and strategically selecting actions to maximize disagreement among them, OHCAM effectively reduces uncertainty and adapts to noisy observations. Experimental results across six benchmark planning domains show that OHCAM achieves superior sample efficiency and task-solving capabilities compared to existing baselines, with successful validation on a Kinova Gen3 robot.
OHCAM outperforms traditional methods by efficiently learning complex action models from limited data, even in the presence of noise.
Accurate action models are critical for effective planning. Existing action-model learning methods largely assume simple action representations or become computationally intractable when learning conditional and quantified effects. We present Online Hypothesis-Driven Conditional Action Model Learning (OHCAM), an online approach for learning action models with conditional and quantified effects from limited interactions with the environment. OHCAM maintains a belief over hypothesized action models and actively selects informative actions to reduce uncertainty by maximizing disagreement among competing hypotheses, while being robust to noisy observations. To enable scalability, OHCAM begins with a small set of simple action model hypotheses and expands to more complex conditions only when the current hypotheses become inconsistent with the data. Experiments on six benchmark planning domains demonstrate that OHCAM is sample efficient in learning action models that solve substantially more tasks than baselines, even with observation noise. We validate OHCAM on two tasks using a Kinova Gen3 robot, demonstrating the real-world applicability of our approach.