Search papers, labs, and topics across Lattice.
This survey critically examines the impact of data heterogeneity on the convergence of Federated Learning (FL), categorizing non-IID data traits and their influence on training stability. By linking experimental data splitting practices to their real-world implications and analyzing how data vulnerabilities affect convergence under various conditions, the authors provide actionable insights for practitioners. The findings reveal that understanding and addressing data characteristics can significantly enhance the robustness and predictability of FL systems.
Non-IID data traits can drastically influence Federated Learning convergence, with measurable impacts that practitioners can leverage for more stable training outcomes.
Federated Learning (FL) has emerged as a promising solution for data hunger in centralized learning. This paradigm enables privacy with multiple clients to train a shared-task model collaboratively without exposing their local data. While being a key component in any learning system, data is also a primary source of vulnerabilities and challenges, and a major determinant of a stable and well-converged training. Existing FL reviews describe general foundations, security practices, opportunities, challenges, and applications, without delving into diverse aspects of data and considering problems from the data perspective. They rarely provide a data-lens synthesis that links concrete data properties, split protocols, and defenses to convergence speed and stability. This survey fills that gap with three advances. First, we analyze non-IID into measurable traits and rank their influence on convergence as strong, medium, or light, explaining the mechanisms behind each and reconciling evidence across images, texts, and graphs. Second, we connect experimental splitting practices to the real phenomena they emulate, expose the artifacts they introduce, and show how those artifacts affect target accuracy. Third, we analyze how data-related vulnerabilities and their proposed defenses affect convergence, reporting performance under clean and adversarial conditions to make the convergence-robustness trade-off explicit. To our knowledge, this is the first survey to provide a complete understanding of data-related challenges that govern FL. With clear takeaways distilled for each concern, our work serves as actionable guidance, helping practitioners design their system with predictable convergence and stability.
