Search papers, labs, and topics across Lattice.
This study investigates how the induction of skills in large language model (LLM) agents affects their transferability across tasks, focusing on the differences between task-level and subtask-level skill induction as well as text versus code skill formats. The findings reveal that subtask-level skills generally enhance performance compared to a no-memory baseline, while task-level skills tend to degrade it; additionally, text skills demonstrate superior transferability over code skills. A novel skill utility score, derived from the combined properties of specificity and abstractness, effectively predicts task success and serves as a practical diagnostic tool for evaluating skill memory prior to task execution.
Subtask-level skills can boost LLM performance beyond baseline levels, while task-level skills often hinder it鈥攈ighlighting a critical distinction in skill transferability.
Large language model (LLM) agents can induce skills from completed tasks and reuse them later to grow more capable with experience. In practice, induced skills may transfer unreliably and can even harm the agent that retrieves them. When agent-induced skills transfer reliably across tasks remains an open question. We conduct a comprehensive and controlled study of how the way skills are induced shapes their transfer across tasks. Specifically, we compare task-level with subtask-level skill induction and text with code skill formats, the two axes along which existing methods differ. Task-level skills mostly reduce the agent's performance below its no-memory baseline while subtask-level skills raise it above on average, and text skills transfer better than code skills. To further understand our findings, we examine two complementary properties of the induced skills: specificity, which measures how closely a skill matches real tasks, and abstractness, which measures how evenly its relevance spreads across tasks. Neither property alone predicts task success, but their combined effect does, which we propose as a skill utility score. The score correlates consistently with task success when skills are transferred, and subtask-level and text skills score higher. Computing skill utility only needs the skills and task descriptions but not any task execution, so our score serves as a practical diagnostic of a skill memory before any new task runs.
