Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study introduces Cross-lingual Retrieval-Augmented Classification (CRAC) to enhance automatic dysarthria severity assessment by utilizing speech data from different languages. By employing a supervised contrastive learning approach to create a severity-focused embedding space and a vector database from an opposite-language corpus, CRAC effectively retrieves and fuses relevant references during classification. The method demonstrates significant improvements in accuracy, achieving 87.3% on Korean and 86.7% on Italian datasets, outperforming monolingual baselines by substantial margins of 8.4 and 20.0 percentage points, respectively.
CRAC leverages multilingual data to boost dysarthria severity assessment accuracy, achieving up to 20% improvement over traditional methods.
Automatic dysarthria severity assessment is limited by the scarcity of labeled pathological speech data. To address this, we propose Cross-lingual Retrieval-Augmented Classification (CRAC), which leverages speech from a different language via an align-retrieve-fuse pipeline. Supervised contrastive learning first shapes a severity-focused embedding space, then a vector database is built from the opposite-language corpus. During both training and inference, the classifier retrieves top-k references from the aligned space and fuses them with the input via cross-attention. Evaluated on Korean post-stroke and Italian ALS dysarthria datasets under a speaker-independent three-class protocol, CRAC achieves balanced accuracies of 87.3% on Korean and 86.7% on Italian, improving over monolingual baselines by 8.4 and 20.0 percentage points, respectively.