Search papers, labs, and topics across Lattice.
The paper introduces ProxyFL, a federated semi-supervised learning framework, to address both external (cross-client) and internal (labeled vs. unlabeled data) heterogeneity challenges. ProxyFL uses learnable classifier weights as a proxy to represent category distributions, optimizing a global proxy against outliers to mitigate external heterogeneity and employing a positive-negative proxy pool to re-include discarded samples and correct potentially incorrect pseudo-labels, thereby tackling internal heterogeneity. Experiments demonstrate ProxyFL's improved performance and convergence in FSSL settings.
By using a unified proxy to simultaneously combat both external and internal data heterogeneity, ProxyFL achieves significant performance and convergence improvements in federated semi-supervised learning.
Federated Semi-Supervised Learning (FSSL) aims to collaboratively train a global model across clients by leveraging partially-annotated local data in a privacy-preserving manner. In FSSL, data heterogeneity is a challenging issue, which exists both across clients and within clients. External heterogeneity refers to the data distribution discrepancy across different clients, while internal heterogeneity represents the mismatch between labeled and unlabeled data within clients. Most FSSL methods typically design fixed or dynamic parameter aggregation strategies to collect client knowledge on the server (external) and / or filter out low-confidence unlabeled samples to reduce mistakes in local client (internal). But, the former is hard to precisely fit the ideal global distribution via direct weights, and the latter results in fewer data participation into FL training. To this end, we propose a proxy-guided framework called ProxyFL that focuses on simultaneously mitigating external and internal heterogeneity via a unified proxy. I.e., we consider the learnable weights of classifier as proxy to simulate the category distribution both locally and globally. For external, we explicitly optimize global proxy against outliers instead of direct weights; for internal, we re-include the discarded samples into training by a positive-negative proxy pool to mitigate the impact of potentially-incorrect pseudo-labels. Insight experiments & theoretical analysis show our significant performance and convergence in FSSL.
