Search papers, labs, and topics across Lattice.
This paper critically examines how the construction of EHR-based datasets, particularly the ScAN dataset derived from MIMIC-III clinical notes, influences the detection of suicidality in clinical NLP. It highlights that the operationalization of suicidality is shaped by factors such as governance constraints, ICD-based cohort selection, and the aggregation of data at the hospital-stay level, which can lead to misleading interpretations of clinician-documented judgments. The authors call for a more nuanced understanding of the assumptions underlying these datasets, as they often conflate diverse clinical framings into singular labels that may not accurately reflect the complexities of suicidality.
EHR-based datasets may misrepresent suicidality by oversimplifying diverse clinical contexts into misleading labels.
Clinical NLP increasingly relies on electronic health record (EHR) data to detect suicidal behaviors, treating clinical documentation as more reliable ground truth than social media. We argue that this framing obscures how EHR-based suicidality datasets encode a particular operationalization of suicidality, shaped by who authors the data, how episodes are bounded, and how ambiguity is resolved. We ground this argument in a case study of the ScAN dataset, built over MIMIC-III clinical notes. We show how governance constraints, ICD-based cohort selection, single-annotator labeling, and hospital-stay-level aggregation produce labels that reflect clinician-documented judgments, treat suicidality as a bounded episode, and assume that intent can be reliably inferred from documentation. A linguistic analysis demonstrates that identical labels subsume heterogeneous clinical framings differing in temporality, negation, and uncertainty. We argue that clinical NLP should examine the assumptions embedded in suicidality datasets before interpreting their labels as ground truth.
UW