Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces SpeechDx, a comprehensive benchmark for clinical speech AI that encompasses 12 datasets and 27 tasks related to various health conditions, structured around the stages of speech production: conceptualization, formulation, and articulation. By evaluating state-of-the-art audio encoders under zero-shot cross-condition transfer, the study reveals that while large-scale speech models provide the best overall performance, domain-specific models only excel in closely related tasks, highlighting a significant gap in generalization across the clinical speech landscape. The findings underscore the need for a unified framework to assess and advance general-purpose clinical speech representations, facilitating better comparisons and understanding of clinical speech AI capabilities.
Large-scale speech models outperform domain-specific ones, but no current model reliably generalizes across diverse clinical speech tasks.
Speech offers a uniquely informative window into health by simultaneously engaging neurological, motor, respiratory, and vocal systems. Current clinical speech AI methods have largely progressed through isolated condition-specific studies, making results difficult to compare and generalization difficult to assess. We introduce SpeechDx, a large-scale benchmark for clinical speech AI spanning 12 datasets and 27 tasks across diverse health conditions. To enable evaluation across shared clinical mechanisms, SpeechDx structures tasks by the stage of speech production they disrupt: conceptualization, formulation, and articulation. The benchmark tests generalization by including tasks with limited labeled data and evaluating the same health condition across multiple datasets, distinguishing clinically meaningful patterns from dataset artefacts. We systematically evaluate 12 state-of-the-art audio encoders across all tasks and under zero-shot cross-condition transfer. Results show that large-scale speech models represent the strongest overall baselines, domain-specific models improve performance only on closely matched tasks, and no current representation generalizes reliably across the clinical speech landscape. SpeechDx establishes a shared evaluation framework for tracking progress toward general-purpose clinical speech representations