Search papers, labs, and topics across Lattice.
This paper introduces PsyScore, a novel framework that integrates psychometric assessment with adaptive instructional feedback in automated essay scoring. By employing a Trait-Adaptive Neural IRT Scorer and a ZPD-Scaffolded Feedback Generator, PsyScore effectively tailors feedback to individual learner proficiency levels while maintaining psychometric interpretability. Experiments reveal that PsyScore not only achieves competitive scoring accuracy but also enhances the pedagogical relevance of the feedback provided to students.
Tailoring feedback to individual student abilities could revolutionize how automated essay scoring systems support personalized learning.
Effective Automated Essay Scoring (AES) are expected to support both reliable assessment and actionable instructional feedback. However, existing approaches often treat scoring and feedback as separate components: neural scoring models provide limited interpretability, while Large Language Model (LLM)-based feedback is typically insensitive to learners proficiency levels. To address this fragmentation, this work proposes PsyScore, a psychometrically-aware framework that integrates diagnostic assessment with instructional scaffolding through a shared latent ability representation. PsyScore comprises three key modules: a Trait-Adaptive Neural IRT Scorer that incorporates the Graded Partial Credit Model (GPCM) into a neural architecture, enabling the precise estimation of student ability while maintaining psychometric interpretability, a ZPD-Scaffolded Feedback Generator, which conditions multi-agent feedback strategies on the diagnosed ability parameter to adapt instructional focus across different proficiency levels, and a Multi-Perspective Feedback Evaluation Strategy that assesses feedback quality via pairwise preference judgements and student revision simulations. Experiments on the ASAP++ dataset demonstrate that PsyScore achieves competitive scoring performance while providing more pedagogically aligned feedback.
