Search papers, labs, and topics across Lattice.
This paper critiques the current approach to generative AI agents, which equates understanding with query resolution, arguing that this fails when users have "epistemic incompleteness" (lack awareness of what they don't know). The authors propose that generative proactivity requires grounding in both epistemology (philosophy of ignorance) and behavioral science to avoid unconstrained and potentially harmful interventions. They argue that these theoretical frameworks can guide the design of responsible and meaningful AI partnerships.
Generative AI's "proactivity" is often just sophisticated guessing, missing the crucial ability to identify and address what users *don't* know they need.
Generative AI agents equate understanding with resolving explicit queries, an assumption that confines interaction to what users can articulate. This assumption breaks down when users themselves lack awareness of what is missing, risky, or worth considering. In such conditions, proactivity is not merely an efficiency enhancement, but an epistemic necessity. We refer to this condition as epistemic incompleteness: where progress depends on engaging with unknown unknowns for effective partnership. Existing approaches to proactivity remain narrowly anticipatory, extrapolating from past behavior and presuming that goals are already well defined, thereby failing to support users meaningfully. However, surfacing possibilities beyond a user's current awareness is not inherently beneficial. Unconstrained proactive interventions can misdirect attention, overwhelm users, or introduce harm. Proactive agents, therefore, require behavioral grounding: principled constraints on when, how, and to what extent an agent should intervene. We advance the position that generative proactivity must be grounded both epistemically and behaviorally. Drawing on the philosophy of ignorance and research on proactive behavior, we argue that these theories offer critical guidance for designing agents that can engage responsibly and foster meaningful partnerships.
