Track synthesis, materials and catalysis as it is published.
Search papers, labs, and topics across Lattice.
To enable cross-agent experience sharing without model fine-tuning, the authors develop EpiCon, a shared multimodal memory framework that decouples task-level trial refinement from persistent knowledge consolidation. The architecture operates via two specialized 2B models—a controller that selectively refines text and visual guidance across attempts and a tree self-organizer that hierarchically structures reusable rules. Across 11 multimodal benchmarks, EpiCon consistently outperforms memoryless baselines by 1.7 to 4.9 macro-average points while cutting memory-operation latency by 67% to 74% compared to backbone-sized memory alternatives.
Heterogeneous visual agents can boost downstream performance by up to 4.9 points across diverse tasks simply by reading from a shared, self-organizing 2B memory tree—without updating a single host model weight.
Agents can learn from past executions, but enabling different agents to reuse and build on one another's experience remains challenging. We introduce EpiCon, a shared multimodal memory framework for agent collective learning without updating host model parameters. EpiCon links question-level memory evolution to a persistent experience bank through two independently trained 2B models: a memory controller and a tree self-organizer. The controller jointly refines textual guidance and visual evidence across attempts and selectively includes visual memory. The self-organizer consolidates lessons hierarchically and retrieves experience and rules for new problems. We evaluate EpiCon on eleven benchmarks spanning four multimodal task domains, using two harnesses and multiple backbones. A frozen bank improves other systems even with a single solving attempt. A second harness raises the original system's macro-average score by 2.6 points across eleven benchmarks. Across four host configurations, EpiCon improves macro-average scores by 1.7 to 4.9 points over No Memory and reduces memory-operation time by 67\% to 74\% relative to backbone-sized memory models.
MIT CSAIL