Search papers, labs, and topics across Lattice.
This study investigates how collaborative settings influence LLM usage among 96 undergraduate students engaged in both individual and team assignments over a semester. The findings reveal a significant 42.7 percentage point drop in LLM usage when students transitioned to team projects, accompanied by simpler prompting strategies and less rigorous verification of AI-generated outputs. Notably, 18.9% of students who regularly utilized LLMs individually ceased their usage entirely in teams, highlighting a critical shift in engagement that suggests the need for better support in collaborative learning environments.
Teamwork dramatically reduces students' deliberate engagement with LLMs, with nearly 19% of individual users abandoning them entirely in collaborative settings.
As large language models (LLMs) become common in computing courses, we need to understand how the social setting shapes how students use them. This paper reports findings from a semester-long study of 96 undergraduate students who completed six assignments, alternating between individual homework and team project milestones. We tracked LLM usage, prompting habits, and how students verified AI-generated output across all six assignments. LLM usage dropped by 42.7 percentage points when students moved from individual work to their first team milestone, then partly recovered in later team tasks. Students also wrote fewer and simpler prompts, used fewer intentional prompting strategies, and checked LLM output less carefully. The share of students who ran tests on AI-generated code fell by 19.4 percentage points during team assignments and never fully rebounded. A within-student analysis found that 18.9% of students who consistently used LLMs on their own stopped using them entirely in teams, while only 3.2% went the other direction. These results suggest that collaborative context is associated with reduced deliberate LLM engagement beyond what task type alone can explain. The moment students form teams appears to be a critical and currently unsupported turning point in computing course design.
