Search papers, labs, and topics across Lattice.
This study addresses the inadequacy of current self-harm surveillance methods by leveraging emergency department triage notes to enhance detection capabilities. Utilizing a three-stage machine learning framework that incorporates large language models for screening and evidence extraction, the authors achieved high precision in identifying self-harm across multiple hospital settings. The approach demonstrated robust transferability, with AUPRCs exceeding 0.88 in both internal and external validations, and accurately identified primary self-harm methods with 95% accuracy, enabling more detailed surveillance.
Achieving over 95% accuracy in identifying self-harm methods, this approach revolutionizes surveillance by moving beyond binary classifications.
Self-harm is a major public health concern, but current surveillance relying on hospital presentations is inadequate due to the low sensitivity of diagnostic codes. Emergency Department (ED) triage notes, recorded at the initial point of contact, provide a succinct summary of presentations and an opportunity to identify self-harm. We developed a three-stage approach, augmenting traditional machine learning with large language model-based screening and evidence extraction to detect self-harm in ED triage notes. We assessed model transferability across three Australian hospitals. Our approach showed AUPRCs of 0.887 +/- 0.016 and 0.884 +/- 0.012 during internal and external validation. Prospectively, it achieved AUPRC of 0.881 +/- 0.008 at the development site, and 0.879 +/- 0.012 and 0.816 +/- 0.015 at two external sites without site-specific retraining. A key advantage of the approach is that it enables identification of the primary self-harm method with an accuracy of 95%, supporting more granular surveillance beyond binary classification.
