Search papers, labs, and topics across Lattice.
This paper addresses the limitations of large language models (LLMs) in tutoring by proposing a structured approach that separates the responsibilities of curriculum sequencing, Socratic dialogue, and knowledge state inference. By constructing a prerequisite knowledge graph and utilizing a lightweight Proximal Policy Optimization (PPO) policy for decision-making, the system effectively determines which topics to teach and how to engage with the student. The results demonstrate that this method significantly improves student mastery rates and reduces the number of dialogue turns compared to existing models and heuristics.
Structuring tutoring interactions with a knowledge graph and a PPO policy leads to faster student mastery than traditional unstructured LLM dialogues.
Large language models are now widely used for everyday learning, but the underlying interactions are typically unstructured chats rather than following a curriculum. Unlike formal online learning systems, these interactions carry no prior record of the student, so any estimate of what the student already knows must be inferred from the dialogue itself. We show that this gap is not closed by scaling models alone. Frontier and education-tuned LLMs perform poorly when asked to tutor a student over an extended session, because doing so requires three things at once. The tutor must sequence a curriculum, conduct Socratic dialogue, and infer the student's knowledge state from that dialogue. We propose separating these responsibilities. Given a student query, our system constructs a prerequisite knowledge graph in which subtopics are nodes and dependencies are edges, and frames tutoring as deciding which node to teach next and how many dialogue turns to spend on it before moving on. A lightweight PPO policy handles this sequencing decision, while an LLM conducts the Socratic exchange at the chosen node and returns a signal of student progress. Across held-out STEM and non-STEM topics, our PPO-paired tutor outperforms heuristic baselines, frontier general-purpose models, and a model specialised for Socratic dialogue: on both the rate at which students reach full curriculum mastery and the number of turns required. Explicit curriculum structure delivers gains that scaling the underlying model does not.
