Search papers, labs, and topics across Lattice.
This paper introduces Intelligent Schema Memory (ISM), a memory-augmented system designed to enhance mathematical reasoning in a frozen language model through continual learning, even amidst challenging episodic resets. By maintaining a compact and self-refining bank of strategy schemas derived from both successes and failures, ISM leverages symbolic tools for intermediate step verification and answer certification. The results demonstrate that ISM significantly outperforms passive, retrieval, and reflection baselines on MATH-Hard and OlympiadBench, achieving superior performance with considerably fewer schemas than traditional methods.
ISM achieves superior mathematical reasoning performance with 64% and 86% fewer schemas than the best passive baseline, proving that compact, actively maintained memory systems can outperform larger, static ones.
We propose Intelligent Schema Memory (ISM), a self-evolving memory-augmented system that improves mathematical reasoning for a frozen LLM under continual learning with hard episodic resets. ISM maintains a compact, self-refined bank of strategy schemas learned from both successful and failed episodes, with symbolic tools that check intermediate steps and certify answers.Without updating model parameters, ISM outperforms passive, retrieval, and reflection baselines on MATH-Hard and OlympiadBench, using 64% and 86% fewer schemas respectively than the strongest passive baseline. These results show that small, actively maintained, and verified strategy memories can support reliable continual mathematical reasoning under strict episodic isolation.
