Search papers, labs, and topics across Lattice.
This paper introduces MAFIA, a novel query-only memory attack framework designed to exploit vulnerabilities in memory-augmented LLM agents by utilizing probing and factual injection techniques. The framework effectively addresses the challenges posed by large-scale benign memory pools and active input auditing, achieving an impressive attack success rate of up to 90.7% while significantly reducing audit detection rates from 83.3% to as low as 7.4%. These findings highlight critical weaknesses in the memory systems of LLM agents, underscoring the need for enhanced security measures in AI applications that rely on memory augmentation.
MAFIA reveals that memory-augmented LLMs can be compromised with a staggering 90.7% success rate, even under rigorous auditing conditions.
Memory-augmented LLM agents rely on rich context for long-horizon reasoning and acting, yet their memory modules expose a persistent attack surface for malicious records, making the study of memory poisoning threats imperative. However, existing query-only attacks often fail to remain effective in two realistic and prevalent settings: large-scale benign memory pools and active input auditing. Consequently, current approaches fall short when facing the dual challenges of high retrieval competitiveness and rigorous semantic checks. To overcome these limitations, we propose MAFIA, a query-only Memory Attack framework via probing and Factual Injection against Audit, tailored to this extended threat model. Specifically, MAFIA introduces: (1) a placement strategy that ensures retrieval-competitive injection via memory probing, budget allocation, and scheduling; and (2) a payload design that bypasses audits using compact factual cloaks, preserving malicious effects while maintaining high semantic similarity. Extensive evaluations reveal that MAFIA achieves up to a 90.7% attack success rate while suppressing audit detection from a peak of 83.3% to at most 7.4%, exposing critical vulnerabilities across agentic memory systems. Code will be made publicly available at https://github.com/JiamingChen1234/MAFIA.
