Search papers, labs, and topics across Lattice.
This paper investigates the use of a causal episodic memory system, MERIT, to enhance the performance of feedback-driven agents in Text-to-SQL tasks without requiring parameter updates. By maintaining an online dual-polarity memory of successful corrections and failed attempts, MERIT improves execution accuracy from 66.34% to 69.79% on the Spider benchmark, demonstrating the efficacy of leveraging finalized repair outcomes. The findings reveal that while MERIT provides notable improvements in certain contexts, its performance compared to other memory retrieval methods varies across different datasets.
Causal memory can boost execution accuracy in Text-to-SQL tasks, but its effectiveness is context-dependent and not universally superior to other retrieval methods.
LLM agents that repair failures often discard successful corrections, forcing later episodes to rediscover similar solutions. We study whether finalized repair outcomes can improve subsequent Text-to-SQL episodes without parameter updates. We introduce MERIT, a training-free agent that maintains an online dual-polarity memory of oracle-verified corrections and observed unsuccessful directions. Under oracle-assisted benchmark feedback, only memories from earlier finalized episodes are eligible for retrieval. A deterministic classifier assigns a coarse failure type, which conditions a hybrid lexical-dense retriever before the frozen model generates each revision. Using Qwen2.5-7B-Instruct with identical initial predictions and repair budgets, MERIT improves execution accuracy over stateless iterative repair from \(66.34\%\) to \(69.79\%\) on Spider and from \(47.35\%\) to \(48.44\%\) on BIRD. Paired analyses provide clear evidence for the Spider gain but weaker evidence on BIRD. MERIT is not reliably separated from untyped dynamic retrieval on either benchmark, while Reflexion-style memory reaches \(51.24\%\) on BIRD at substantially higher inference cost. Ablations show that negative memory contributes modestly, the value of type conditioning and lexical--dense ranking is dataset dependent, and schema-local experience provides the most consistent benefit. These results clarify when causal cross-query memory improves repair and when broader memory representations remain preferable.
