Search papers, labs, and topics across Lattice.
This paper identifies a critical challenge in AI agent memory management, termed the "Compaction Cliff," where safety rules and episodic logs compete for limited token budgets, leading to significant loss of safety rule retention. By introducing Knowledge Triage, a framework that classifies knowledge types and applies tailored retention policies, the authors achieve substantial improvements in safety rule preservation across multiple agent configurations. The proposed method outperforms existing compaction techniques, preserving 2-4 times more safety rules and achieving high recall rates in various benchmarks, thereby enhancing the reliability of AI agents in safety-critical applications.
The Compaction Cliff reveals that traditional memory management in AI agents can lead to a dramatic loss of safety rules, but Knowledge Triage offers a robust solution that significantly enhances retention.
A safety rule and an episodic log compete for the same tokens in an AI agent's context. When the budget overflows, both are summarized at the same rate; only the rule needs exact wording to remain enforceable. On 20 production agent configurations, Claude Code's /compact prompt on Sonnet 4.6 preserves 53\% of safety rules after one compaction round and 10\% after five. We name this the Compaction Cliff. We address it with Knowledge Triage, a framework that classifies each line of an agent's knowledge base by type and routes each type through its own retention policy. Three deterministic operators implement this triage across the three context-management operations: TypeCompact rewrites items in place under per-type fidelity, TypeDecompose partitions a topic too large to compact safely, replicating in-scope safety rules across partitions, and TypeRetrieve fetches items from external storage with in-scope rules pinned ahead of relevance. On five public corpora, TypeCompact preserves 2--4$\times$ more safety rules than the strongest single-shot LLM compactor at every ratio, with 96\% recall over five rounds. TypeDecompose reaches 0\% locality violations against 93\% under uniform partitioning. TypeRetrieve reaches 100\% recall@50 against 73\% for the best single-shot LLM retriever. On three downstream behavioral benchmarks, we outperform the production Sonnet compactor on medical compliance (paired McNemar $p<10^{-8}$ on preservation, $N = 200$), the full-policy and hierarchical baselines on retail task pass rate ($p<0.01$, $N = 115$), and the hierarchical compaction on the airline domain ($p = 0.024$). We release AgentArtifactCorpus (396{,}934 agent configurations from 54{,}628 public GitHub repositories), the classifier, and the reference implementation.
