Search papers, labs, and topics across Lattice.
This paper introduces a synthetic data generation pipeline for long-context audio reasoning, specifically doctor-patient conversations, to address the lack of suitable training and evaluation resources. The pipeline leverages persona-driven dialogue generation, multi-speaker audio synthesis with realistic acoustic modeling, and LLM-based SOAP note generation, all built on open-weight models. Experiments using the generated dataset (8,800 conversations, 1.3k hours of audio) reveal that cascaded approaches outperform end-to-end models for SOAP note generation from long-form audio.
Open-weight models can now generate realistic, long-form doctor-patient conversations with corresponding SOAP notes, providing a valuable resource for training and evaluating long-context audio reasoning systems.
Long-context audio reasoning is underserved in both training data and evaluation. Existing benchmarks target short-context tasks, and the open-ended generation tasks most relevant to long-context reasoning pose well-known challenges for automatic evaluation. We propose a synthetic data generation pipeline designed to serve both as a training resource and as a controlled evaluation environment, and instantiate it for first-visit doctor-patient conversations with SOAP note generation as the task. The pipeline has three stages, persona-driven dialogue generation, multi-speaker audio synthesis with overlap/pause modeling, room acoustics, and sound events, and LLM-based reference SOAP note production, built entirely on open-weight models. We release 8,800 synthetic conversations with 1.3k hours of corresponding audio and reference notes. Evaluating current open-weight systems, we find that cascaded approaches still substantially outperform end-to-end models.
