Search papers, labs, and topics across Lattice.
Affiliation:
1
0
3
Inspired by the efficient communication principles of federated learning (FL), this work introduces two hybrid algorithms - FL+FSDP and FL+HSDP - interleaving sharded DP with FedAvg-style aggregations, demonstrating superior computational efficiency and improved model quality.
