Search papers, labs, and topics across Lattice.
This study analyzes the types of questions students ask generative AI systems during problem-solving in two computer science tasks, utilizing the Graesser et al. taxonomy to classify inquiries into 18 distinct types. By employing a few-shot learning approach, the researchers automatically categorized 830 student interactions, revealing that a small subset of question types dominates student inquiries and that these types evolve significantly as tasks progress. These findings highlight the dynamic nature of student-AI interactions and suggest that understanding inquiry patterns can enhance AI support for learning.
A small subset of question types drives the majority of student inquiries in AI interactions, revealing a dynamic evolution in questioning as tasks progress.
Background and Context: Question and inquiry are integral parts of knowledge seeking and learning. Despite their importance, students tend not to ask enough questions in the classroom. However, studies have shown that students interact extensively with generative AI systems for learning and problem solving. Objective: In this paper, we seek to better understand the types of questions that students ask AI systems, and how those questions evolve during problem solving and across tasks. Method: We use the Graesser et al. taxonomy to classify students' inquiries into 18 types. We develop a few-shot learning approach to automatically classify students' interactions with AI into these categories. We use this system to analyze 830 interactions of CS2 students across two programming tasks. Findings: Our results suggest that a small subset of question types accounts for the majority of student inquiries, and that the types of questions students ask change substantially as the task progresses.
