Search papers, labs, and topics across Lattice.
This paper introduces Neural Procedural Memory (NPM), a novel framework that enhances the autonomy of Large Language Models (LLMs) by employing implicit activation steering instead of relying on explicit textual instructions. By distilling procedural skills from historical experiences into steering vectors, NPM effectively activates the relevant neural mechanisms for task execution, demonstrating comparable performance to traditional methods across four agent benchmarks. The findings reveal that combining implicit steering with explicit workflows leads to improved robustness in task execution and highlights the structured nature of the activation space in encoding task logic.
Implicit activation steering enables LLMs to autonomously execute tasks with a memory system that outperforms traditional explicit instruction methods.
While Large Language Models (LLMs) excel as static solvers, transforming them into autonomous agents remains challenging. This transition requires continuous environmental interaction, yet current agents lack the necessary persistent procedural memory. Existing approaches predominantly employ Retrieval-Augmented Generation (RAG) to inject explicit textual guidelines into model contexts. However, relying solely on symbolic instructions can introduce a text-action disconnect, frequently failing to activate the internal representations necessary for correct task execution. To address this, the paper introduces Neural Procedural Memory (NPM), a training-free framework that represents agent memory through implicit activation steering rather than explicit instructions. By distilling procedural skills from historical contrastive experiences into steering vectors in the activation space, NPM directly activates the task-relevant neural mechanisms to guide task execution. Evaluations across four agent benchmarks show that NPM performs comparably to baselines using explicit textual instructions. Furthermore, the results show that combining implicit steering with explicit workflows provides complementary advantages, leading to more robust task execution. Representational analyses indicate that these steering vectors encode consistent task logic, forming organized structures within the activation space. These findings suggest that implicit activation steering provides a promising approach for managing agent memory.
