Search papers, labs, and topics across Lattice.
Evaluating the trajectory of agentic generative AI in education, this work argues that conventional human-centered and value-sensitive design paradigms fail to prevent cognitive offloading, user isolation, and systemic epistemic dependence. The authors counter these systemic failure modes by defining an emancipatory framework focused on sustained learner flourishing rather than frictionless task completion. They formulate initial design principles and an overarching methodology that explicitly account for external economic incentives and human cognitive shortcuts, delineating open technical challenges for agent design.
Optimizing educational AI for immediate user preferences actively reinforces cognitive dependence and isolation, exposing a fundamental blind spot in standard human-centered design.
The hype around generative AI seems to promise unprecedented productivity (and learning) gains. However, these technologies' increasing agentic features seem to push learners towards individualism (or individual isolation), over-reliance, and dependence on them. Human-centered design approaches (e.g., value-sensitive design) assume that, by unearthing human needs, preferences, and values, technology researchers/designers may avoid such dangers, which are driven by wider systemic factors like economic incentives or inherent human limitations (e.g., our tendency to seek, in the moment, the easiest path of action). Yet, so far these efforts seem insufficient to guide our design of educational technology that avoids the aforementioned dependency and isolation dangers, while finding widespread adoption. This paper presents an alternative, more emancipatory vision for future educational AI technology, oriented towards learner flourishing while considering the wider complex systems they inhabit, including tentative design principles and an overall design methodology. Yet, many open questions remain before this vision can be realized.
