Search papers, labs, and topics across Lattice.
This paper introduces SFedHIFI, a spiking federated learning (SFL) framework designed to handle system heterogeneity by allowing clients to deploy SNN models of varying scales based on their resources. SFedHIFI uses channel-wise matrix decomposition for adaptive model complexity and a heterogeneous information fusion module for cross-scale aggregation. Experiments on three benchmarks show SFedHIFI outperforms baselines and achieves energy savings compared to ANN-based FL with minimal accuracy loss.
Overcome resource constraints in federated learning by enabling clients to train spiking neural networks of varying sizes and aggregate their knowledge effectively.
Spiking Federated Learning (SFL) has been widely studied with the energy efficiency of Spiking Neural Networks (SNNs). However, existing SFL methods require model homogeneity and assume all clients have sufficient computational resources, resulting in the exclusion of some resource-constrained clients. To address the prevalent system heterogeneity in real-world scenarios, enabling heterogeneous SFL systems that allow clients to adaptively deploy models of different scales based on their local resources is crucial. To this end, we introduce SFedHIFI, a novel Spiking Federated Learning framework with Fire Rate-Based Heterogeneous Information Fusion. Specifically, SFedHIFI employs channel-wise matrix decomposition to deploy SNN models of adaptive complexity on clients with heterogeneous resources. Building on this, the proposed heterogeneous information fusion module enables cross-scale aggregation among models of different widths, thereby enhancing the utilization of diverse local knowledge. Extensive experiments on three public benchmarks demonstrate that SFedHIFI can effectively enable heterogeneous SFL, consistently outperforming all three baseline methods. Compared with ANN-based FL, it achieves significant energy savings with only a marginal trade-off in accuracy.
