Search papers, labs, and topics across Lattice.
This paper introduces an offline contextual bandit framework for optimizing instructional policies in Intelligent Tutoring Systems (ITS) using logged interaction data, circumventing the need for costly online experiments. By employing a Rasch model to map student-item interactions onto a continuous proficiency-difficulty scale, the authors reformulate the tutoring process as a continuous stochastic bandit problem, integrating a novel reward function that balances task challenge with student success. The proposed method demonstrates significant policy improvements across four large-scale datasets, enabling rapid learning and visualization of effective instructional strategies without additional data collection.
Learning adaptive instructional policies from logged data can yield significant improvements in tutoring effectiveness within seconds, eliminating the need for costly online experiments.
Optimizing instructional policies in Intelligent Tutoring Systems (ITS) typically requires costly online experimentation or student simulators that may fail to capture real-world dynamics. This paper introduces an offline contextual bandit framework that learns new adaptive policies directly from logged interaction data. By mapping student-item interactions onto a continuous latent proficiency-difficulty scale using a Rasch model, we cast the tutoring process as a continuous stochastic bandit problem. We propose a novel reward function designed to optimize ''flow'' by balancing task challenge with student success. Our approach includes a round-specific behavior policy estimation that serves as both a propensity model for off-policy evaluation and a diagnostic tool for ITS adaptivity. We demonstrate the efficacy of this framework across four large-scale real-world datasets, achieving consistent policy improvements over the logged behavior policy. The results show that effective instructional policies can be learned and visualized within seconds of computation, providing a scalable path for improving adaptive learning systems without further data collection.
