Search papers, labs, and topics across Lattice.
This paper investigates how instruction-tuning LLMs on student responses containing misconceptions impacts reasoning abilities, creating a trade-off between faithful misconception modeling and preserving correct reasoning. They introduce MalAlgoLib, a library for generating algebra problems with both correct and misconception-specific erroneous solution traces, and train two models: a Novice Student Misconception Model (single misconception) and an Expert Tutor Misconception Model (multiple misconceptions). Their experiments reveal that the student model overgeneralizes misconceptions, while the tutor model can learn multiple misconceptions without sacrificing correct-solving accuracy, but only when provided with intermediate reasoning step supervision.
Training LLMs to simulate student misconceptions can backfire, degrading overall reasoning accuracy unless you provide detailed, step-by-step feedback during training.
Effective educational AI depends on modeling student misconceptions. Such models enable realistic learner simulation and diagnostic, adaptive tutoring. However, instruction-tuning large language models on student responses containing misconception errors can degrade reasoning abilities, creating a tension between faithful misconception modeling and preserving correct reasoning in other contexts. To support both learner simulation and tutoring, we study two misconception-aware models: the Novice Student Misconception Model, trained to acquire a single misconception for simulating an individual student, and the Expert Tutor Misconception Model, trained on multiple misconceptions to capture the error patterns a tutor encounters across students. To study the misconception acquisition dynamics of both models, we develop MalAlgoLib, a library that generates algebra problems with correct solution traces and misconception-specific erroneous traces. Our experiments across three LLMs reveal that the student and the tutor model exhibit fundamentally different misconception acquisition dynamics. For the student model, a single misconception is not learned as a context-specific behavior. Models overapply it across problems, degrading correct-solving accuracy unless training includes correct examples to enforce boundaries. In contrast, the tutor model can learn multiple misconceptions jointly without sacrificing correct-solving accuracy. Critically, intermediate reasoning steps are the bottleneck. With final-answer supervision alone, models cannot learn where error enters the solution, so neither the student model nor the tutor model acquires misconceptions regardless of data size. Together, these results, enabled by MalAlgoLib, provide an interpretable account of misconception acquisition under instruction tuning and guidance for training misconception-aware LLMs while preserving correct reasoning.
