Search papers, labs, and topics across Lattice.
This paper introduces DriftGuard, a federated continual learning framework designed to mitigate asynchronous data drift in FL by separating shared and local parameters within a Mixture-of-Experts architecture. DriftGuard employs global retraining for shared parameters upon system-wide drift detection and selective group retraining for local parameters based on MoE gating patterns, avoiding raw data sharing. Experiments demonstrate that DriftGuard achieves comparable or superior accuracy to state-of-the-art methods while reducing retraining costs by up to 83%, leading to a 2.3x improvement in accuracy per unit retraining cost.
Federated learning can adapt to asynchronous data drift with up to 83% less retraining cost by using a Mixture-of-Experts architecture to selectively update local parameters.
In real-world Federated Learning (FL) deployments, data distributions on devices that participate in training evolve over time. This leads to asynchronous data drift, where different devices shift at different times and toward different distributions. Mitigating such drift is challenging: frequent retraining incurs high computational cost on resource-constrained devices, while infrequent retraining degrades performance on drifting devices. We propose DriftGuard, a federated continual learning framework that efficiently adapts to asynchronous data drift. DriftGuard adopts a Mixture-of-Experts (MoE) inspired architecture that separates shared parameters, which capture globally transferable knowledge, from local parameters that adapt to group-specific distributions. This design enables two complementary retraining strategies: (i) global retraining, which updates the shared parameters when system-wide drift is identified, and (ii) group retraining, which selectively updates local parameters for clusters of devices identified via MoE gating patterns, without sharing raw data. Experiments across multiple datasets and models show that DriftGuard matches or exceeds state-of-the-art accuracy while reducing total retraining cost by up to 83%. As a result, it achieves the highest accuracy per unit retraining cost, improving over the strongest baseline by up to 2.3x. DriftGuard is available for download from https://github.com/blessonvar/DriftGuard.
