Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study investigates the "GenAI substitution hypothesis," which posits that the availability of generative AI tools leads to higher grades and reduced student engagement in courses reliant on take-home assessments. Analyzing data from 156,135 students across 87,936 course offerings at a large U.S. university, the authors employ a differences-in-differences design to assess the impact of GenAI on academic performance and student satisfaction before and after the release of ChatGPT. The results reveal no significant increase in grades or self-reported understanding among students, suggesting that concerns about GenAI undermining educational outcomes may be overstated.
Contrary to fears, generative AI does not inflate grades or diminish student engagement in higher education settings.
The spread of generative AI (GenAI) in higher education has raised concerns that students offload cognitive effort to AI, earning high grades without learning. If this "GenAI substitution hypothesis" is true, grades should rise disproportionately in GenAI-susceptible courses--those relying more on assessments like take-home problem sets and essays rather than in-class exams. Substitution could also affect student satisfaction, measured here as self-reported understanding and interest in the subject, which prior research links to assessments. We test the substitution hypothesis using syllabus and administrative data from a large U.S. university (2015-2025; 156,135 students; 87,936 course offerings). We measure courses' GenAI susceptibility using a human-validated LLM pipeline to extract assessment types from syllabi, and use a differences-in-differences design comparing outcomes across courses before and after ChatGPT's release, while modeling COVID-19 pandemic effects as either persistent or transient. We find no significant differential effect of GenAI availability on grades overall or among previously lower-performing students. Effects on self-reported understanding are likewise insignificant; effects on interest are significant only assuming transient pandemic effects. Our findings temper concerns that GenAI inflates grades and reduces students' satisfaction.