Search papers, labs, and topics across Lattice.
This paper revisits asynchronous federated learning (FL) aggregation, challenging the exclusive use of Euclidean distance for measuring gradient staleness. It explores alternative distance metrics to better capture the impact of staleness on model convergence and accuracy, integrating these metrics into the aggregation process. Experiments under heterogeneous clients and non-IID data show that specific metrics enhance convergence speed, model performance, and training stability compared to Euclidean distance alone.
Euclidean distance isn't the best way to measure gradient staleness in asynchronous federated learning: alternative distance metrics can significantly improve convergence and stability.
In asynchronous federated learning (FL), client devices send updates to a central server at varying times based on their computational speed, often using stale versions of the global model. This staleness can degrade the convergence and accuracy of the global model. Previous work, such as AsyncFedED, proposed an adaptive aggregation method using Euclidean distance to measure staleness. In this paper, we extend this approach by exploring alternative distance metrics to more accurately capture the effect of gradient staleness. We integrate these metrics into the aggregation process and evaluate their impact on convergence speed, model performance, and training stability under heterogeneous clients and non-IID data settings. Our results demonstrate that certain metrics lead to more robust and efficient asynchronous FL training, offering a stronger foundation for practical deployment.
