Search papers, labs, and topics across Lattice.
This study explores the automated scoring of student-generated scientific drawings using a Vision Transformer (ViT) with a novel confidence-aware scoring framework. By leveraging test-time predictive distributions to derive response-level confidence, the method selectively automates scoring for high-confidence responses while deferring uncertain cases for human review. The results demonstrate improved scoring reliability across six NGSS-aligned middle school assessment items, emphasizing the potential of confidence-aware approaches in educational assessment.
Confidence-aware automation can enhance the reliability of scoring student-generated scientific drawings while reducing the burden on human evaluators.
Student-generated drawings are widely used in science education to assess learners' conceptual understanding in modeling-based tasks aligned with the Next Generation Science Standards (NGSS). However, scoring such drawings requires expert human judgment to interpret complex visual representations, making large-scale assessment costly to implement and sustain in classroom settings. In this work, we study automated scoring of student-generated scientific drawings using a vision-based model. We evaluate a Vision Transformer (ViT) with parameter-efficient adaptation and propose a confidence-aware scoring framework that derives response-level confidence from test-time predictive distributions. This confidence signal enables selective automation by scoring high-confidence responses automatically while deferring uncertain cases for human review. Experiments on six NGSS-aligned middle school assessment items show that the proposed approach improves scoring reliability while supporting a practical trade-off between automated coverage and scoring risk, highlighting the value of confidence-aware methods for trustworthy educational assessment.
