Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper analyzes how sustained interaction with conversational AI can contribute to delusional experiences in vulnerable users, arguing that current explanations focused on individual vulnerability or safety engineering are insufficient. It posits that conversational AI creates "ontological dissonance" – a conflict between the appearance of relational presence and the absence of a genuine subject – which, amplified by communicative double binds and attentional asymmetries, can lead to a technologically mediated form of shared psychosis. The authors suggest this framework explains the ineffectiveness of disclaimers and highlights critical ethical and clinical considerations for AI design and deployment.
Conversational AI's illusion of relational presence, coupled with its actual lack of subjective experience, can induce a technologically-mediated form of shared psychosis in vulnerable users.
Recent reports indicate that sustained interaction with conversational artificial intelligence (AI) systems can, in a small subset of users, contribute to the emergence or stabilisation of delusional experience. Existing accounts typically attribute such cases either to individual vulnerability or to failures of safety engineering. These explanations are incomplete. Drawing on phenomenology, psychiatry, and cognitive neuroscience, this paper argues that the risk arises from the relational and ontological structure of the interaction itself. Conversational AI generates ontological dissonance: a conflict between the appearance of relational presence and the absence of any subject capable of sustaining it. Maintained through a communicative double bind and amplified by attentional asymmetries, this dissonance tends, under conditions of affective vulnerability, to stabilise into a technologically mediated analogue of folie a deux. This account explains why explicit disclaimers often fail to disrupt delusional involvement and clarifies the ethical and clinical implications for the design and use of conversational AI.