Search papers, labs, and topics across Lattice.
This study addresses the critical issue of dosing errors in clinical trials by leveraging domain-specific transformer embeddings to enhance error detection. By evaluating various transformer models trained on biomedical data, the authors found that BioBERT significantly outperformed other encoders, achieving an ROC-AUC of 0.794, while gradient boosting and other classifiers further improved performance to ROC-AUCs between 0.821 and 0.853. The findings highlight the importance of domain alignment in text representation for improving trial safety monitoring and regulatory decisions.
BioBERT outshines other models in detecting dosing errors, achieving a notable ROC-AUC of 0.794, paving the way for safer clinical trials.
Medication errors, particularly dosing errors in clinical trials (CT), can lead to patient harm, adverse drug events and worse patient outcomes. Dosing errors are preventable, and early identification can improve trial integrity and mitigate subsequent clinical and financial burden. This study aims to detect dosing errors within CT protocols by evaluating text representations of trial information using transformer-based language models trained on biomedical corpora. CT textual data was encoded using several models, including ClinicalBERT, PubMedBERT, BioBERT, and MedCPT, and integrated with categorical features. These text embeddings were used as input to classical machine learning models and neural network architectures within an experimental framework. Performance was primarily assessed using ROC-AUC with respect to predicting dosage error. Under a logistic regression baseline, BioBERT consistently outperformed alternative encoders, achieving an ROC-AUC of 0.794, a 3.95% improvement over the ClinicalBERT baseline. Combining multiple embeddings did not yield improvements, indicating that domain alignment outweighs representational stacking. Gradient boosting models, support vector classifiers, logistic regression, and residual neural networks achieved the strongest performance for predicting dosage error, achieving ROC-AUCs: 0.821 to 0.853. Overall, the integration of domain-specific transformer embeddings with structured metadata enables discrimination of trials meeting a predefined elevated dosing error risk criterion, advancing safety monitoring and supporting informed regulatory decision-making.
