Search papers, labs, and topics across Lattice.
This study introduces a multimodal framework for detecting Mild Cognitive Impairment (MCI) from spontaneous speech by integrating cross-model fusion of speech, text, and image data while employing a novel unlearning technique to mitigate the influence of demographic attributes. The approach addresses the significant performance disparities observed across different demographic subgroups, achieving superior classification results on multilingual benchmarks TAUKADIAL and PREPARE. Key findings reveal that the proposed method not only enhances overall classification accuracy but also reduces the performance gap, demonstrating the effectiveness of demographic unlearning in creating robust representations for MCI detection.
Unlearning demographic biases in MCI detection leads to a 30% reduction in performance gaps across patient subgroups, revolutionizing equitable healthcare screening.
Mild Cognitive Impairment (MCI) is a medical condition characterized by a noticeable decline in memory, language, or thinking abilities. MCI detection from spontaneous speech is promising for scalable screening. However, learned models often exploit demographic cues correlated with labels, resulting in a large performance gap across subgroups. We present a multimodal framework that combines (i) cross-model fusion between modalities (speech, text, and image), and (ii) unlearning using gradient reversal that discourages the shared embedding from encoding task-irrelevant demographic attributes. Evaluated on the multilingual benchmarks TAUKADIAL and PREPARE, our method outperforms the state-of-the-art multilingual and multimodal baseline in MCI classification while substantially reducing the performance gap across patient subgroups (sex and language). We further analyze transfer across datasets, showing that demographic unlearning helps learn more robust representations for MCI detection.