Search papers, labs, and topics across Lattice.
The paper introduces CA-AFP, a federated learning framework that addresses statistical and system heterogeneity by integrating clustering and adaptive pruning. CA-AFP employs a cluster-aware importance scoring mechanism based on weight magnitude, intra-cluster coherence, and gradient consistency to identify parameters for pruning, along with an iterative pruning schedule that allows weight regrowth. Experiments on UCI HAR and WISDM datasets demonstrate that CA-AFP improves accuracy, fairness, and communication efficiency compared to pruning baselines, while also exhibiting robustness to varying levels of non-IID data.
Federated learning models can be significantly compressed and made more fair across clients by pruning different parts of the model for different clusters of users, without sacrificing accuracy.
Federated Learning (FL) faces major challenges in real-world deployments due to statistical heterogeneity across clients and system heterogeneity arising from resource-constrained devices. While clustering-based approaches mitigate statistical heterogeneity and pruning techniques improve memory and communication efficiency, these strategies are typically studied in isolation. We propose CA-AFP, a unified framework that jointly addresses both challenges by performing cluster-specific model pruning. In CA-AFP, clients are first grouped into clusters, and a separate model for each cluster is adaptively pruned during training. The framework introduces two key innovations: (1) a cluster-aware importance scoring mechanism that combines weight magnitude, intra-cluster coherence, and gradient consistency to identify parameters for pruning, and (2) an iterative pruning schedule that progressively removes parameters while enabling model self-healing through weight regrowth. We evaluate CA-AFP on two widely used human activity recognition benchmarks, UCI HAR and WISDM, under natural user-based federated partitions. Experimental results demonstrate that CA-AFP achieves a favorable balance between predictive accuracy, inter-client fairness, and communication efficiency. Compared to pruning-based baselines, CA-AFP consistently improves accuracy and lower performance disparity across clients with limited fine-tuning, while requiring substantially less communication than dense clustering-based methods. It also shows robustness to different Non-IID levels of data. Finally, ablation studies analyze the impact of clustering, pruning schedules and scoring mechanism offering practical insights into the design of efficient and adaptive FL systems.
