Search papers, labs, and topics across Lattice.
This paper introduces the Experience Memory Graph (EMG), a novel framework that reformulates the recovery of LLM agents from failures in complex tasks as a graph matching problem. By converting both failed and successful trajectories into directed action decision graphs, EMG identifies common subgraphs and graph edit paths that provide explicit correction strategies without iterative trial-and-error. Experimental results demonstrate that EMG significantly enhances the success rate and average reward of agents in environments like ALFWorld and ScienceWorld, outperforming existing reflection-based methods.
Agents using the Experience Memory Graph can recover from failures in a single execution, eliminating the need for costly trial-and-error loops.
Large Language Model (LLM) agents have shown remarkable capabilities in autonomous decision-making by generating sequential trajectories of states, actions, and observations. However, in complex, long-horizon tasks, these agents frequently suffer from compounding errors and struggle to recover from failures. Existing self-correction mechanisms rely on prompt-based reflection, which is inherently brittle, incurs heavy time and API costs due to iterative trial-and-error loops, and produces task-specific memory that may be hard to generalize to new scenarios. To address this, we propose Experience Memory Graph (EMG), a framework that reformulates agent failure recovery as a graph matching problem. At training time, we convert both failed exploration trajectories and successful expert trajectories into directed action decision graphs. By matching these graphs, we extract common subgraphs (successful workflows) and graph edit paths that explicitly indicate how to correct failures (e.g., which actions to add, delete, or relabel under a given observation), and store them in a memory graph with intra-task nodes and cross-task edges. At test time, EMG retrieves relevant insights and guides the agent in a single, loop-free execution. Experiments on ALFWorld and ScienceWorld show that EMG consistently outperforms state-of-the-art reflection baselines in success rate and average reward, while requiring no test-time trial-and-error.
