Search papers, labs, and topics across Lattice.
The paper introduces GAM-RAG, a training-free retrieval-augmented generation framework that dynamically updates its retrieval memory based on recurring or related queries to improve efficiency and performance. GAM-RAG constructs a lightweight hierarchical index and uses sentence-level feedback from successful retrieval episodes to update sentence memories, making relevant evidence easier to activate over time. The framework employs an uncertainty-aware, Kalman-inspired gain rule to balance stability and adaptability in memory updates, resulting in a 3.95% performance improvement over strong baselines and a 61% reduction in inference cost.
By dynamically updating retrieval memory based on past successes, GAM-RAG slashes inference costs by 61% while boosting RAG performance by nearly 4%.
Retrieval-Augmented Generation (RAG) grounds large language models with external evidence, but many implementations rely on pre-built indices that remain static after construction. Related queries therefore repeat similar multi-hop traversal, increasing latency and compute. Motivated by schema-based learning in cognitive neuroscience, we propose GAM-RAG, a training-free framework that accumulates retrieval experience from recurring or related queries and updates retrieval memory over time. GAM-RAG builds a lightweight, relation-free hierarchical index whose links capture potential co-occurrence rather than fixed semantic relations. During inference, successful retrieval episodes provide sentence-level feedback, updating sentence memories so evidence useful for similar reasoning types becomes easier to activate later. To balance stability and adaptability under noisy feedback, we introduce an uncertainty-aware, Kalman-inspired gain rule that jointly updates memory states and perplexity-based uncertainty estimates. It applies fast updates for reliable novel signals and conservative refinement for stable or noisy memories. We provide a theoretical analysis of the update dynamics, and empirically show that GAM-RAG improves average performance by 3.95% over the strongest baseline and by 8.19% with 5-turn memory, while reducing inference cost by 61%. Our code and datasets are available at: https://anonymous.4open.science/r/GAM_RAG-2EF6.
