Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces ORBIT, a novel framework for zero-shot cross-lingual Alzheimer's disease detection that synergizes multilingual speech and text representations through adversarial learning. By leveraging cross-attentive fusion and multi-tap language adversaries, the approach effectively mitigates language-specific biases while enhancing the detection of cognitive impairment markers. Empirical evaluations demonstrate that ORBIT significantly outperforms unimodal baselines and simple concatenation methods, establishing a new standard for reliable cross-lingual Alzheimer's detection.
Multimodal fusion in ORBIT achieves superior zero-shot performance in Alzheimer's detection across languages, revealing the power of language-invariant representations.
In this work, we study zero-shot cross-lingual speech-based Alzheimer's disease detection (SADD). We hypothesize that learning language-invariant multimodal representations by fusing multilingual speech and text pretrained models is essential for reliable transfer to unseen languages, as the two modalities capture complementary acoustic and linguistic markers of cognitive impairment while adversarial learning suppresses language-specific confounds. Empirical results in zero-shot cross-lingual evaluation substantiate the hypothesis, showing that multimodal fusion consistently outperforms unimodal baselines. To this end, we propose ORBIT, a novel framework that combines cross-attentive fusion, multi-tap language adversaries, and complementary spherical--hyperbolic geometric learning with consensus clustering. Across settings, ORBIT achieves the strongest performance compared to unimodal models and simple concatenation-based fusion baselines.