Search papers, labs, and topics across Lattice.
This paper introduces a CEFR-inspired framework for automated assessment of Scratch programming skills using Fuzzy C-Means clustering on Dr. Scratch evaluation data. By mapping clusters to CEFR levels (A1-C2) with an ordinal criterion, the framework provides competency levels and actionable insights for curriculum design. Results reveal a "B2 bottleneck" in Scratch proficiency, attributed to challenges in Logic Synchronization and Data Representation, and offers certainty-based triggers for instructor intervention.
Discover how Fuzzy C-Means clustering can automatically assess programming skills and reveal hidden curriculum bottlenecks, like the B2 barrier in Scratch where learners struggle with Logic Synchronization and Data Representation.
Context: Schools, training platforms, and technology firms increasingly need to assess programming proficiency at scale with transparent, reproducible methods that support personalized learning pathways. Objective: This study introduces a pedagogical framework for Scratch project assessment, aligned with the Common European Framework of Reference (CEFR), providing universal competency levels for students and teachers alongside actionable insights for curriculum design. Method: We apply Fuzzy C-Means clustering to 2008246 Scratch projects evaluated via Dr.Scratch, implementing an ordinal criterion to map clusters to CEFR levels (A1-C2), and introducing enhanced classification metrics that identify transitional learners, enable continuous progress tracking, and quantify classification certainty to balance automated feedback with instructor review. Impact: The framework enables diagnosis of systemic curriculum gaps-notably a "B2 bottleneck" where only 13.3% of learners reside due to the cognitive load of integrating Logic Synchronization, and Data Representation--while providing certainty--based triggers for human intervention.
