Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces MMLA-RSI, a recursive self-improvement framework for agents that modifies both policy and memory through Reasoning-Time Training (RTT) and Reasoning-Time Memory Adaptation (RTMA) respectively, with each adaptation method also becoming subject to improvement. The system employs bounded executable rule languages and shared interfaces to enable a successor agent to take over the role of the current updater or manager. Empirical results show significant error reduction in program selection tasks by retaining LARC feedback updates, though online benefits in continuous-integration replay and SQL tasks require further investigation.
Agents can recursively improve their problem-solving by learning to adapt their own policy and memory management strategies, achieving substantial error reduction in program selection.
An agent can improve its behavior within an unresolved problem by changing how it acts and which experience it retains. We propose MMLA-RSI, a recursive self-improvement scheme with two implementations in Memory-Mediated Learning Architecture: Reasoning-Time Training (RTT) changes the policy state $Φ$, while Reasoning-Time Memory Adaptation (RTMA) changes authoritative memory $M$. Each route also makes its adaptation method an object of improvement. A current numerical updater trains the policy proposing its successor; a current memory manager chooses the records available to the process proposing its successor. An independently admitted successor takes over the same role in the next generation. We give bounded executable rule languages, shared task/proposal interfaces, and one algorithm for either route or their composition. The RTT instance changes scalar schedules in a clipped-momentum update. The RTMA instance chooses NULL or a complete-row write with possible eviction. A fixed interpreter, trusted committer, and independent evaluator bound what can change. State versions, read closures, and conditional properties describe causal execution, accepted transitions, and finite work. Existing numerical-component studies motivate the construction. In four-candidate program selection, retaining LARC feedback updates reduces expected error by 24.65 and 36.65 percentage points for two trained initializations. In chronological continuous-integration replay, feedback binding is positive while retention increases loss. Completed SQL studies improve substantially over an unadapted substrate but do not establish the required additional online benefit. These results characterize their declared components. The two recursive routes and their joint realization are specified here; their beneficial recursive chains and discovery efficiency remain to be evaluated.