Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
The paper introduces Probabilistic Recurrent Intention Switching Model (PRISM), a novel inverse reinforcement learning (IRL) approach that uses a recurrent network to infer per-step intention distributions from observation history. This allows for modeling non-stationary rewards and goal switching within episodes without relying on Markov assumptions or fixed history windows. PRISM's EM objective decomposes into independent per-intention reward subproblems solvable in closed form, leading to an efficient E-step, and experiments on gridworlds, mouse mazes, and robotic manipulation show PRISM recovers temporally coherent intentions and achieves higher held-out log-likelihood than existing methods.
IRL can now efficiently infer temporally coherent, switchable goals from complex robot manipulation data, revealing that discrete goal switching may be a common strategy in both biological and artificial agents.
Inverse reinforcement learning (IRL) recovers reward functions from observed behavior, yet traditional methods assume a single stationary reward that cannot capture goal switching within an episode. Recent multi-intention IRL methods address this by segmenting trajectories, but model intention transitions as either a memoryless Markov chain or via manual state augmentation with a fixed history window. We propose the Probabilistic Recurrent Intention Switching Model (PRISM), which replaces both mechanisms with a lightweight recurrent network that maps observation history to a per-step intention distribution. We prove that the resulting EM objective decomposes exactly into independent per-intention reward subproblems, each solvable in closed form, yielding an $\mathcal{O}(nK)$ E-step with no variational approximation. We evaluate PRISM on a non-Markovian gridworld, a mouse labyrinth, and BridgeData~V2 robotic manipulation, the first large-scale robotic application of multi-intention IRL. Across all settings PRISM achieves the highest held-out log-likelihood while recovering nameable, temporally coherent intentions from unlabeled demonstrations, suggesting that discrete goal switching is present in both biological and artificial agents.