Search papers, labs, and topics across Lattice.
The paper argues that current agentic memory systems, which rely on lookup mechanisms like vector stores and retrieval-augmented generation, fundamentally differ from true memory systems that generalize through abstract rules. This conflation leads to limitations in agent capability, long-term learning, and security vulnerabilities, including a generalization ceiling on compositional tasks and susceptibility to persistent memory poisoning. Drawing inspiration from neuroscience's Complementary Learning Systems theory, the authors advocate for integrating fast exemplar storage with slow weight consolidation to overcome these limitations.
Today's AI agents aren't really "remembering" – they're just taking notes, which means they'll hit a wall on complex tasks and can be easily brainwashed.
Current agentic memory systems (vector stores, retrieval-augmented generation, scratchpads, and context-window management) do not implement memory: they implement lookup. We argue that treating lookup as memory is a category error with provable consequences for agent capability, long-term learning, and security. Retrieval generalizes by similarity to stored cases; weight-based memory generalizes by applying abstract rules to inputs never seen before. Conflating the two produces agents that accumulate notes indefinitely without developing expertise, face a provable generalization ceiling on compositionally novel tasks that no increase in context size or retrieval quality can overcome, and are structurally vulnerable to persistent memory poisoning as injected content propagates across all future sessions. Drawing on Complementary Learning Systems theory from neuroscience, we show that biological intelligence solved this problem by pairing fast hippocampal exemplar storage with slow neocortical weight consolidation, and that current AI agents implement only the first half. We formalize these limitations, address four alternative views, and close with a co-existence proposal and a call to action for system builders, benchmark designers, and the memory community.
