Search papers, labs, and topics across Lattice.
This paper introduces an automated framework for selecting aggregation strategies in federated learning (FL), addressing the challenge that no single strategy consistently performs best across diverse FL scenarios. The framework uses large language models to infer suitable strategies based on data characteristics in a single-trial mode, and a genetic search algorithm to explore alternatives under budget constraints in a multi-trial mode. Experiments demonstrate improved robustness and generalization under non-IID conditions compared to manual selection.
Stop hand-tuning your federated learning aggregation strategy: this framework uses LLMs and genetic search to automate the process and boost performance.
Federated Learning enables collaborative model training without centralising data, but its effectiveness varies with the selection of the aggregation strategy. This choice is non-trivial, as performance varies widely across datasets, heterogeneity levels, and compute constraints. We present an end-to-end framework that automates, streamlines, and adapts aggregation strategy selection for federated learning. The framework operates in two modes: a single-trial mode, where large language models infer suitable strategies from user-provided or automatically detected data characteristics, and a multi-trial mode, where a lightweight genetic search efficiently explores alternatives under constrained budgets. Extensive experiments across diverse datasets show that our approach enhances robustness and generalisation under non-IID conditions while reducing the need for manual intervention. Overall, this work advances towards accessible and adaptive federated learning by automating one of its most critical design decisions, the choice of an aggregation strategy.