Search papers, labs, and topics across Lattice.
This paper introduces HORMA, a Hierarchical Organize-and-Retrieve Memory Agent designed to enhance the performance of large language model (LLM) agents on long-horizon tasks by structuring experiences in a hierarchical memory format. By decomposing working memory into structured memory construction and navigation-based retrieval, HORMA effectively reduces inference costs and latency while maintaining detailed information access. The results demonstrate that HORMA outperforms existing methods, achieving up to 77.83% reduction in token usage while improving task performance across various benchmarks like ALFWorld and LoCoMo.
Efficiently navigating hierarchical memory can cut token usage by over 77% while boosting task performance in LLMs.
Large language model (LLM) agents struggle with long-horizon tasks due to their inherent statelessness, requiring all task-relevant information to be encoded in growing input contexts. The resulting degraded reasoning quality, increased inference cost, and higher latency necessitate efficient working memory mechanisms. However, existing approaches either rely on lossy compression or similarity-based retrieval, which often fail to capture temporal structure and causal dependencies required for multi-step agentic tasks. In this work, we present HORMA, a Hierarchical Organize-and-Retrieve Memory Agent that organizes experience into a file-system-like hierarchical structure, where summarized entities are linked to the corresponding raw trajectories, enabling efficient access without losing detailed information. HORMA decomposes working memory into two stages: structured memory construction and navigation-based retrieval. The construction module iteratively refines how experiences are structured by distinguishing between failures caused by missing information and those caused by misleading or overloaded context. The navigation module retrieves task-relevant context by traversing the hierarchy using a lightweight agent trained with reinforcement learning to select minimal yet sufficient context, thereby reducing latency along the critical execution path. Across ALFWorld, LoCoMo, and LongMemEval, HORMA improves task performance under constrained context budgets while requiring at most 22.17% of the baseline token usage in long conversation tasks. Compared to existing methods, it consistently achieves better efficiency-performance trade-offs and generalizes effectively to unseen tasks.
