Search papers, labs, and topics across Lattice.
This study explores the generation of high-order questions in a multilingual educational context, utilizing Large Language Models (LLMs) guided by prompts based on Claim-Evidence-Reasoning and Divergent Questioning frameworks. The research reveals that while LLMs can effectively generate questions in Basque, Spanish, and English, only approximately 50% of these questions are acknowledged by educators as high-order. Notably, the alternative frameworks yield a diverse range of question types, indicating their potential to enhance traditional educational practices beyond Bloom's Taxonomy.
Only half of the high-order questions generated by LLMs are recognized by teachers as such, revealing a gap in educational applicability.
Critical thinking is a fundamental skill that helps learners move beyond simple memorization. One way to develop this skill is through high-order questioning. However, crafting such questions remains a challenge for educators, and classroom practices tend to rely on low-order questions. Large Language Models have demonstrated strong capabilities in generating high-order questions, especially when guided by prompts based on Bloom's Taxonomy. Yet, existing research has largely centered on this framework and focused only on English. This study addresses these gaps by introducing prompts grounded in two alternative frameworks: Claim-Evidence-Reasoning and Divergent Questioning within a multilingual context using Basque, Spanish, and English. Results indicate that while both an open-source and a proprietary model rather effectively generate questions in all three languages, only about half of the answerable questions are recognized by teachers as high-order. A positive finding is that the alternative frameworks produce structurally and conceptually varied questions, suggesting they could complement each other and provide viable alternatives to Bloom's Taxonomy.