Search papers, labs, and topics across Lattice.
The paper introduces Goal Recognition Alignment through Imitation Learning (GRAIL) to address the limitations of traditional goal recognition methods that assume optimal goal-oriented policies. GRAIL uses imitation learning and inverse reinforcement learning to learn a goal-directed policy for each candidate goal from demonstration trajectories, accommodating suboptimal and biased behavior. Experiments across various domains demonstrate that GRAIL significantly improves F1-score in scenarios with biased, suboptimal, and noisy optimal behavior, while maintaining competitive performance in optimal settings.
Learn goal recognition from imperfect human behavior, and watch accuracy jump by 50% when the demonstrator is systematically biased.
Understanding an agent's goals from its behavior is fundamental to aligning AI systems with human intentions. Existing goal recognition methods typically rely on an optimal goal-oriented policy representation, which may differ from the actor's true behavior and hinder the accurate recognition of their goal. To address this gap, this paper introduces Goal Recognition Alignment through Imitation Learning (GRAIL), which leverages imitation learning and inverse reinforcement learning to learn one goal-directed policy for each candidate goal directly from (potentially suboptimal) demonstration trajectories. By scoring an observed partial trajectory with each learned goal-directed policy in a single forward pass, GRAIL retains the one-shot inference capability of classical goal recognition while leveraging learned policies that can capture suboptimal and systematically biased behavior. Across the evaluated domains, GRAIL increases the F1-score by more than 0.5 under systematically biased optimal behavior, achieves gains of approximately 0.1-0.3 under suboptimal behavior, and yields improvements of up to 0.4 under noisy optimal trajectories, while remaining competitive in fully optimal settings. This work contributes toward scalable and robust models for interpreting agent goals in uncertain environments.
