Search papers, labs, and topics across Lattice.
This paper introduces FedSPM, a novel framework for routing-enabled federated learning that effectively addresses dual heterogeneity by modeling both inter-client and intra-client variations through client-specific latent components. By combining predictive and feature distributions, FedSPM enhances the routing process, allowing for improved prediction accuracy in scenarios where clients exhibit distinct subpopulations, such as patients with different disease subtypes. Experimental results on benchmark datasets and real-world medical data reveal significant advancements in both routing efficiency and predictive performance compared to existing methods.
Routing-enabled federated learning can now leverage hidden subpopulations within clients, leading to substantial gains in prediction accuracy and routing efficiency.
Routing-prediction federated learning has emerged as a new paradigm that reframes inter-client heterogeneity as a resource for system-level intelligence: at inference time, the server routes each external query to the best-matched client for prediction. Existing approaches, however, typically treat each client as internally homogeneous, overlooking latent subpopulations within local data. For example, patients with the same diagnosis at one hospital may exhibit morphologically distinct disease subtypes. The coexistence of inter-client and intra-client heterogeneity, which we call dual heterogeneity, can impair both routing and prediction. To address this challenge, we propose FedSPM, a routing-enabled semiparametric mixture framework that represents each client using client-specific latent components. Each component combines a predictive distribution for classification with a feature distribution for routing. To flexibly model feature distributions while effectively sharing information across clients, FedSPM models their density ratios relative to a common nonparametric measure estimated via empirical likelihood. We develop a federated expectation-maximization algorithm that optimizes a tractable surrogate and prove convergence of the exact profiled objective at the standard $\mathcal{O}(1/\sqrt{T})$ rate when the surrogate errors are properly controlled. Experiments on controlled benchmarks and real-world medical data demonstrate consistent improvements in routing and prediction under dual heterogeneity. Code is available at https://github.com/zijianwang0510/FedSPM.
