Search papers, labs, and topics across Lattice.
This paper introduces EvoMem, a memory-augmented architecture designed to enhance LLM-driven evolutionary program search by capturing and reusing successful mutation strategies across runs and tasks. By converting successful mutation events into structured, task-aware advice, EvoMem enables the retrieval of relevant instructions to guide future mutations, thereby reducing redundant exploration. Experimental results demonstrate that EvoMem achieves significant improvements in optimization metrics and search speed across various benchmarks, highlighting its effectiveness in leveraging persistent memory for evolutionary search.
Persistent memory in EvoMem reduces redundant exploration in evolutionary code search, leading to faster and more effective optimization across multiple tasks.
Successful mutation strategies in evolutionary code search may contain reusable knowledge that is useful beyond a single run, and in some cases may transfer across related tasks and domains. However, existing LLM-driven evolutionary frameworks largely discard such knowledge, repeatedly rediscovering similar ideas and limiting opportunities for cross-run and cross-task learning. We introduce EvoMem, a persistent memory architecture for LLM-based evolutionary program search that captures and reuses candidate mutation knowledge. EvoMem converts successful mutation events into structured, task-aware advice for future runs. It operates in two phases: after each run, it extracts and stores promising ideas with provenance, and during subsequent evolution, it retrieves a small set of relevant instructions based on the current task and program context to guide mutation. Across geometric optimization, multi-hop question answering, GPU kernel optimization, and related benchmarks, our experiments show positive average improvements in target metrics or search speed for most evaluated settings, while also revealing variability across tasks. Overall, EvoMem provides evidence that persistent memory can reduce some redundant exploration and improve the reuse and adaptation of successful strategies in LLM-driven evolutionary search.
