Search papers, labs, and topics across Lattice.
The authors introduce EMSDialog, a synthetic dataset of 4,414 multi-speaker emergency medical service dialogues generated from electronic patient care reports (ePCRs) using a multi-LLM agent pipeline. This pipeline iteratively plans, generates, and self-refines dialogues, incorporating rule-based checks for factual accuracy and topic flow. Experiments demonstrate that training conversational diagnosis prediction models with EMSDialog improves accuracy, timeliness, and stability.
Training on synthetically generated multi-party medical dialogues closes the gap in accuracy, timeliness, and stability for conversational diagnosis prediction.
Conversational diagnosis prediction requires models to track evolving evidence in streaming clinical conversations and decide when to commit to a diagnosis. Existing medical dialogue corpora are largely dyadic or lack the multi-party workflow and annotations needed for this setting. We introduce an ePCR-grounded, topic-flow-based multi-agent generation pipeline that iteratively plans, generates, and self-refines dialogues with rule-based factual and topic flow checks. The pipeline yields EMSDialog, a dataset of 4,414 synthetic multi-speaker EMS conversations based on a real-world ePCR dataset, annotated with 43 diagnoses, speaker roles, and turn-level topics. Human and LLM evaluations confirm high quality and realism of EMSDialog using both utterance- and conversation-level metrics. Results show that EMSDialog-augmented training improves accuracy, timeliness, and stability of EMS conversational diagnosis prediction.
