Search papers, labs, and topics across Lattice.
This paper introduces EMBER, a learned retention policy designed to optimize memory usage in long-horizon agents by implementing a budgeted evidence survival strategy. The method focuses on determining which source evidence to retain before a query is known, thereby minimizing retrieval and rereading costs while maximizing answer relevance. Experimental results on LongMemEval-RR demonstrate that EMBER-14B significantly outperforms traditional budgeted baselines, achieving an F1 score of 0.3017 compared to 0.1765, highlighting the importance of evidence retention over mere history rereading.
Retaining the right evidence before a query can boost long-horizon agent performance by over 70% in F1 score, transforming how we think about memory management in AI.
Long-horizon agents can archive large histories, but future answers still incur retrieval, rereading, and context costs. When retained memory misses answer-relevant evidence, the system must return to larger portions of the raw history. We study budgeted evidence survival: before the query is known, which source evidence should be retained so that it remains recoverable and usable under a fixed retained source-evidence token budget? We instantiate this setting as Budgeted Pre-Query Retention, where memory is written during ingestion and later read without access to the full raw stream. We introduce EMBER, a learned retention policy that constructs a compact, source-backed evidence state. EMBER stores evidence capsules: verbatim source excerpts paired with retrieval keys and update metadata, preserving both grounding and read-time access. Post-query outcome feedback trains the writer to preserve evidence across the ingestion-retrieval-answer chain. On LongMemEval-RR, our LongMemEval-derived retained-evidence protocol, EMBER-14B reaches 0.3017 F1 at the 8192-token retained-evidence comparison point, compared with 0.1765 for the strongest non-EMBER budgeted baseline. Across retained source-evidence budgets, EMBER improves F1, Retain-Recall, and Read-Recall, indicating that long-horizon memory depends on retaining evidence within the budget rather than rereading larger histories.
NVIDIA