Search papers, labs, and topics across Lattice.
This paper introduces Behavior-Aware Item Modeling (BAIM), a knowledge tracing framework that dynamically enriches item representations by incorporating procedural solution information derived from a reasoning language model. BAIM decomposes item solutions into four stages (understand, plan, carry out, look back) based on Polya's problem-solving framework and generates stage-level representations using embedding trajectories. By adaptively routing these stage-wise representations based on learner context, BAIM achieves superior performance compared to strong pretraining-based baselines on the XES3G5M and NIPS34 datasets, especially with repeated learner interactions.
Capturing the nuances of problem-solving stages with a reasoning LM unlocks significant gains in knowledge tracing accuracy, particularly as learners engage more deeply with the material.
Knowledge Tracing (KT) aims to predict learners'future performance from past interactions. While recent KT approaches have improved via learning item representations aligned with Knowledge Components, they overlook the procedural dynamics of problem solving. We propose Behavior-Aware Item Modeling (BAIM), a framework that enriches item representations by integrating dynamic procedural solution information. BAIM leverages a reasoning language model to decompose each item's solution into four problem-solving stages (i.e., understand, plan, carry out, and look back), pedagogically grounded in Polya's framework. Specifically, it derives stage-level representations from per-stage embedding trajectories, capturing latent signals beyond surface features. To reflect learner heterogeneity, BAIM adaptively routes these stage-wise representations, introducing a context-conditioned mechanism within a KT backbone, allowing different procedural stages to be emphasized for different learners. Experiments on XES3G5M and NIPS34 show that BAIM consistently outperforms strong pretraining-based baselines, achieving particularly large gains under repeated learner interactions.
