Search papers, labs, and topics across Lattice.
This paper introduces FedChronos, a novel framework for federated fine-tuning of time-series foundation models (TSFMs) that addresses the challenges of adapting these models in fragmented data environments. By employing Low-Rank Adaptation (LoRA) with the Chronos-T5 backbone and utilizing FedAvg and FedProx, the authors achieve significant reductions in model update sizes while maintaining performance. The results show that incorporating differential privacy as implicit regularization mitigates overfitting and improves forecasting accuracy, achieving a 31% reduction in mean absolute percentage error compared to zero-shot performance in a non-IID setting of Indian agricultural markets.
Privacy and accuracy can be complementary in federated fine-tuning, with FedChronos achieving a 31% improvement in forecasting accuracy while ensuring data privacy.
Time-series foundation models (TSFMs) such as Chronos have demonstrated strong forecasting capabilities across domains, yet adapting them to institutionally fragmented settings, where data cannot be centralized due to regulatory, competitive, or sovereignty constraints, remains unexplored. We introduce FedChronos, a framework for federated parameter-efficient fine-tuning of an already pre-trained TSFM, a setting that existing federated time-series work has not addressed, since prior methods either pre-train from scratch or align prototypes rather than adapt a fixed backbone. Our approach applies Low-Rank Adaptation (LoRA) to the Chronos-T5 backbone and trains across distributed clients using FedAvg and FedProx, transmitting only lightweight adapter weights (384~KB per round, an 86$\times$ reduction over full-model exchange). We evaluate FedChronos on daily commodity prices from 15 Indian agricultural markets across 9 states, a naturally non-IID federated setting, and find that na茂ve LoRA fine-tuning overfits substantially on small per-client datasets, dropping below zero-shot performance. We further observe that differential privacy (DP) noise can act as implicit regularization and counteract this overfitting: in our experiments the strongest configuration ($\varepsilon = 5$) reduces mean absolute percentage error (MAPE) by 31% over zero-shot and 26% over the best traditional baseline, while bounding each round's information leakage via per-round $(\varepsilon, 未)$-differential privacy. Because the model is compact and the updates are small, the approach also suits edge AI deployments where both the network link and the client device are constrained. Overall, our findings suggest that privacy and accuracy can be complementary rather than competing objectives in federated TSFM fine-tuning.
Microsoft Research