Search papers, labs, and topics across Lattice.
This study investigates the effects of non-IID and noisy datasets on client selection in federated learning (FL), revealing that biased selections can significantly hinder model performance. By experimentally measuring the impacts of data skew and noise on accuracy and convergence, the authors highlight the trade-offs involved in client selection strategies. They introduce a novel privacy-preserving scoring method to evaluate client contributions, demonstrating its effectiveness in enhancing model performance in FL scenarios.
Biased client selections in federated learning can severely degrade model accuracy, but a new scoring method offers a way to optimize client contributions while preserving privacy.
Federated learning (FL) is a popular distributed learning framework where multiple clients perform local training and a server aggregates the locally updated models. FL enables decentralized training while preserving the privacy of clients' datasets. However, non-independent and identically distributed (non-IID) or noisy datasets can lead to low model accuracy or high convergence latency. Precluding these clients through client selection may mitigate the problem, but heavily biased client selections may also degrade the learning performance. In this study, we first experimentally measure the impact of non-IID data (including skews in data quantity and label distribution), noisy data, and fairness in client selection on model accuracy and convergence. We then propose a privacy-preserving scoring method to assess each client's contribution in FL, with experiments conducted to demonstrate the effectiveness of the proposed assessment.
