Search papers, labs, and topics across Lattice.
This study investigates the challenges faced by self-harm prediction models in generalizing across different hospitals, focusing on the lexical and semantic variations in emergency department triage notes. By analyzing triage notes from two hospitals, the authors identify significant differences in lexical expression and feature importance that impact model performance, despite the presence of consistent core themes. The findings underscore the importance of understanding institutional documentation practices to enhance the generalizability of NLP models in clinical settings.
Self-harm prediction models falter across hospitals due to stark lexical differences in triage notes, revealing a critical gap in model generalizability.
Self-harm presentations to emergency departments (EDs) are strongly associated with higher suicide risk. NLP models have shown robust performance in detecting self-harm from triage notes within single hospitals, yet performance often declines across institutions. To examine potential causes, we compare ED triage notes from two hospitals by analyzing lexical characteristics, highly associated predictive features, and salient topics. Our results reveal variation in lexical expression and feature importance related to self-harm across hospitals, despite consistent core themes such as self-poisoning and self-injury. These documentation differences are associated with reduced cross-site performance. Our findings provide insight into how institutional variation affects the identification of self-harm in clinical text and highlight potential methods to improve model generalisability.
