Search papers, labs, and topics across Lattice.
This study evaluates the effectiveness of LLM-generated grammar drill exercises for English as a Foreign Language (EFL) learners by analyzing log data from Japanese junior high school students. It identifies a performance hierarchy among different question types, revealing that multiple-choice questions impose the least cognitive load, while cloze tasks and drag-and-drop exercises present greater challenges in terms of recall and response time. The findings validate the CEFR-J grammar framework, indicating that as student proficiency increases, accuracy declines and response times lengthen, underscoring the importance of strategically sequencing question modalities in educational content.
LLM-generated EFL exercises reveal that question type significantly influences cognitive load and learning outcomes, challenging traditional CEFR assumptions.
This study evaluates the pedagogical viability of LLM-generated English as a Foreign Language (EFL) learning content. Utilising log data from Japanese junior high school students practicing on a grammar drilling application, we analysed how different question modalities impact student performance and whether theoretical localised CEFR difficulty tiers accurately predict empirical task difficulty. Results reveal a clear performance hierarchy: multiple-choice questions carried the lowest cognitive load, cloze tasks posed the greatest barrier to active recall, and drag-and-drop exercises incurred the heaviest time penalties. Furthermore, learner data validated the CEFR-J grammar framework, showing a steady decline in accuracy and increased response times as proficiency levels advanced. These findings demonstrate that LLMs can successfully generate learning content, while highlighting the need for developers to strategically sequence question modalities to transition learners from passive recognition to active linguistic production.
