Search papers, labs, and topics across Lattice.
This paper tackles the challenges of modality imbalance in MultiModal Federated Graph Learning (MM-FGL) by introducing FedMGS, a framework that synthesizes missing modal semantics within a graph-aware latent representation space. By employing an availability-aware graph encoder, a prototype-guided latent semantic synthesizer, and a reliability-calibrated semantic fusion mechanism, the approach effectively mitigates the high variance caused by missing modalities. Experimental results demonstrate that FedMGS achieves significant performance improvements, outperforming competitive baselines by up to 17.41% while maintaining an optimal efficiency-performance tradeoff.
Missing modalities in federated learning can be effectively synthesized, leading to substantial performance gains in multimodal tasks.
MultiModal Federated Graph Learning (MM-FGL) offers a natural collaborative training paradigm, but its practical deployment is challenged by two granularities of modality imbalance. Client-level imbalance occurs when certain clients lack entire modalities, while node-level imbalance occurs when individual nodes exhibit missing visual or textual attributes. While several relevant studies exist, our investigation reveals that they predominantly target graph-agnostic or centralized scenarios, rendering them difficult to adapt directly. To address these challenges, we formalize modality-imbalanced MM-FGL as an implicit graph-aware latent semantic representation synthesis problem. This paradigm recovers missing modal semantics directly within the representation space, thereby maximizing alignment with the original data's semantic distribution and mitigating the high variance induced by missing modalities. To this end, we propose FedMGS (Federated Modality-aware Graph Synthesis), which integrates three core components. The availability-aware graph encoder prevents missing modalities from contaminating local structural propagation. The prototype-guided latent semantic synthesizer establishes cross-client semantic anchors for unavailable modalities. The reliability-calibrated semantic fusion mechanism regulates the impact of recovered latent representations prior to predictive readout. Extensive experiments on four tasks show that FedMGS consistently outperforms competitive baselines with gains up to 17.41% with best efficiency-performance tradeoff.
