Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper details TalTech's approach to the Beyond Transcription Challenge, where they developed systems to generate SOAP notes from doctor-patient conversations without prior transcription. By employing LoRA supervised fine-tuning and DAPO reinforcement learning with a focus on the Open Medical Concept F1 metric, their models achieved top rankings in both lightweight and heavyweight tracks, while also exhibiting the lowest hallucination rates. The findings suggest that leveraging reinforcement learning for concept matching can enhance factual reliability in summarization tasks, particularly when fine-tuning on text transcripts improves performance on speech inputs.
Reinforcement learning against a concept-matching metric can enhance factual reliability in summarizing complex medical conversations without sacrificing performance.
This paper describes TalTech's submissions to the Beyond Transcription Challenge (BeTraC), which requires generating SOAP notes directly from long doctor-patient conversation recordings, without intermediate transcription. After screening open-weight speech LLMs for long-audio robustness, we adapted Voxtral Mini (lightweight track) and Voxtral Small (heavyweight track) with LoRA supervised fine-tuning followed by DAPO reinforcement learning that uses the challenge metric, Open Medical Concept F1, as its reward. Our systems ranked first in both tracks, and an independent LLM-as-a-judge evaluation showed the lowest hallucination rate among all submissions, indicating that reinforcement learning against a concept-matching metric need not compromise factual reliability. We also find that fine-tuning on text transcripts transfers well to speech input and appears to improve robustness on out-of-domain real recordings.