Search papers, labs, and topics across Lattice.
This paper introduces CoreMem, a novel memory architecture for dialogue agents that integrates Riemannian retrieval and Fisher-guided distillation to enhance long-term memory capabilities on consumer-grade hardware. By replacing traditional cosine similarity with a Fisher-Rao metric for retrieval and employing a hierarchical sentence-to-token compression mechanism, CoreMem effectively mitigates issues like the hubness problem and syntactic fragmentation. Evaluations on the LOCOMO and LongMemEval-S benchmarks demonstrate significant accuracy improvements in open-domain and temporal reasoning, all while adhering to an 8 GB VRAM constraint.
CoreMem achieves a remarkable +4.51 percentage point improvement in open-domain reasoning accuracy while operating within a strict 8 GB VRAM budget.
Personalized dialogue agents require continuous long-term memory to maintain coherent interactions across multiple sessions. However, deploying these capabilities on consumer-grade hardware (e.g., 8 GB VRAM edge devices) introduces severe memory and compute bottlenecks. Existing systems typically rely on isotropic cosine similarity for retrieval and heuristic rules for context compression. These approaches lack a unified theoretical foundation, frequently suffering from the hubness problem in high-dimensional retrieval and syntactic fragmentation during compression. To overcome these limitations, we propose CoreMem, a resource-efficient edge-cloud memory architecture fundamentally unified by information geometry. First, Riemannian retrieval replaces cosine matching with a locally adaptive Fisher-Rao metric, effectively penalizing hub memories via Mahalanobis distance with O(Ndr) Woodbury acceleration for real-time search. Second, Fisher-guided discrete token distillation (FDTD) introduces a hierarchical sentence-to-token compression mechanism. It derives sensitivity scores from Fisher information traces, providing a principled compression-KL tradeoff augmented with explicit structural syntax protection. Evaluated on the LOCOMO and LongMemEval-S benchmarks, CoreMem achieves strong accuracy improvements, yielding substantial gains in Open-domain (+4.51 pp) and Temporal (+4.17 pp) reasoning. Extensive profiling confirms that CoreMem operates seamlessly within a strict 8 GB VRAM budget, successfully bridging the gap between resource-constrained edge devices and the demand for theoretically grounded, lifelong memory agents.
Tsinghua AI