Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper formalizes the concept of federated messages in Federated Learning by introducing a mathematical definition that encompasses modern payloads such as synthetic data and federated analytics. It categorizes these messages into three distinct types—model structures, statistical summaries, and data-conditioned representations—while evaluating their trade-offs in terms of computational demands, communication costs, and privacy risks. A review of 202 recent publications reveals a notable shift towards these diverse messaging paradigms, indicating a departure from traditional model weight updates and highlighting the evolving landscape of decentralized training.
A new taxonomy reveals that federated learning is evolving beyond simple weight exchanges, embracing complex message types that could redefine decentralized training strategies.
Federated Learning is rapidly evolving beyond the exchange of traditional model weights and gradients, yet existing definitions fail to capture the full scope of modern payloads like synthetic data and federated analytics. This paper addresses the gap by proposing a formal mathematical definition of a federated message that accounts for both utility and privacy. We introduce a taxonomy that organizes these exchanges into three categories: model structures, statistical summaries, and data-conditioned representations. By evaluating these groups based on computational demands, communication costs, and privacy risks, we provide a clearer understanding of the trade-offs involved in decentralized training. Our review of 202 recent publications highlights a significant shift since 2021 toward diverse messaging paradigms, signaling a move away from standard deep learning updates toward more specialized information sharing. This framework provides a structured path for future research to optimize federated systems for varying hardware and security requirements.