Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study investigates whether Large Language Models (LLMs) can enhance their problem-solving capabilities by utilizing experiential abstractions similar to human strategies and reminders. By extracting natural-language abstractions from LLM solution traces and employing them during inference and reinforcement learning, the authors demonstrate significant improvements in mathematical and logical reasoning tasks. Notably, self-extracted abstractions perform comparably to those extracted by a stronger teacher, indicating that LLMs can effectively distill and apply experiential knowledge across different datasets and models.
LLMs can autonomously extract and leverage experiential abstractions, boosting their reasoning performance to levels comparable with human-like strategies.
Humans distill experience into reusable abstractions, e.g., strategies and cautionary reminders, and apply them to gradually solve problems more effectively. We study whether Large Language Models (LLMs) can similarly benefit from such experiential abstractions. From LLMs'solution traces on the MATH training set, a stronger teacher or the LLMs themselves extract natural-language abstractions into a retrievable library. We explore two usage modes: (1) inference-time retrieval and (2) reinforcement learning (RL) with abstraction-augmented training prompts. Experiential abstractions improve LLM performance on mathematical and logical reasoning benchmarks. Self-extracted abstractions match teacher-extracted ones, and our abstraction usage framework can transfer to other datasets and models. These findings suggest LLMs can extract and apply experiential abstractions much as humans leverage distilled experience.
CMU ML