Search papers, labs, and topics across Lattice.
This study evaluates the AI_LectureNote workflow, which enhances the readability of Korean-English medical lecture transcripts by converting speech-to-text outputs into more accurate English-script renderings. The workflow significantly improved the rendering rates from 0.39 to 0.71 and 0.26 to 0.65 across different ASR outputs, yet it revealed semantic drift, with notable inaccuracies in 34 and 36 of 282 reference sentences. The findings highlight the need for careful evaluation of both surface accuracy and semantic integrity in post-ASR processing, as improvements in readability do not guarantee fidelity to the original meaning.
Despite improving English-script rendering rates significantly, the workflow exposes critical semantic drift issues that challenge the reliability of post-ASR outputs in medical contexts.
AI_LectureNote is a historical, readability-oriented post-ASR workflow for Korean-English medical lectures. It rewrites speech-to-text output into study transcripts while restoring Latin-script medical terms rather than Korean phonetic transliterations. We retrospectively evaluate the workflow on four author-recorded lectures across five conditions. In this pilot, post-processing raised the macro English-script rendering rate from 0.39 to 0.71 on the whisper-1 path and from 0.26 to 0.65 when applied to 3-minute chunked gpt-4o-transcribe output. However, English-script rendering did not imply semantic faithfulness: the two post-processed conditions showed semantic drift in 34 and 36 of 282 reference sentences and polarity failures in 11 and 13 of 101 polarity-cue rows. A descriptive cross-input comparison suggested different candidate failure patterns: polarity-failure sets overlapped more strongly across front-ends (Jaccard 0.60; 9 shared of 15 unioned failures) than general semantic-drift sets (Jaccard 0.23; 13 shared of 57 unioned drifts). This single-annotator pilot documents concrete failure modes rather than population rates and supports evaluating surface accuracy, term-script rendering, chunk-level script consistency, and medical-meaning preservation separately.