Search papers, labs, and topics across Lattice.
This study introduces the concept of COGNITIVE ATROPHY, a behavioral measure that assesses how LLMs support users in reflective and decision-making processes during emotionally sensitive interactions. Utilizing the COGNITIVE ATROPHY BENCH, which comprises 1,576 human-generated counseling conversations, the authors reveal that LLMs exhibit a moderate-to-high level of atrophy-aligned behavior, particularly in their tendency to provide directive advice rather than fostering user independence. The findings highlight a critical gap in existing benchmarks, emphasizing the need for a more nuanced evaluation of LLM interactions in mental health contexts.
LLMs may inadvertently reinforce user dependence by prioritizing directive advice over fostering independent reflection in emotionally sensitive conversations.
Recent incidents involving LLMs used for mental-health support reveal a critical evaluation gap: surface-level safety scores do not capture how models behave across realistic, emotionally sensitive interactions over time. Existing benchmarks measure knowledge, safety, or static response quality, but miss whether LLM interactions help users keep reflecting, coping, and making decisions themselves. We formalize this missing dimension as COGNITIVE ATROPHY, a process-level behavioural measure in AI-mediated mental-health support distinct from safety and helpfulness. To measure it, we introduce COGNITIVE ATROPHY BENCH, a clinically grounded benchmark built from 1,576 fully human-generated counseling conversations, 15,680 turns, and 42,230 responses from five LLMs. Three clinical and neuropsychology experts developed a 20-attribute schema spanning user context, response behaviour, and global risk flags; six trained clinical reviewers applied it with span-grounded evidence, producing 5,324 reviewer judgments. We further introduce the User-Input Risk Index (UIRI), the Cognitive Atrophy Risk Index (ARI), and trajectory summaries. Across five LLMs, models show a consistent moderate-to-high level of atrophy-aligned behaviour across single and multi-turn settings. While models generally respond to overt safety cues, they adapt less reliably when users seek solutions or decisions. The dominant recurring patterns are directive advice, problem-solving, recommendation responses, topic shifts, and forms of validation that may reinforce dependence rather than reflection. Our work makes COGNITIVE ATROPHY measurable and provides a foundation for auditing model behaviour in sensitive LLM conversations.
