Search papers, labs, and topics across Lattice.
FederatedFactory addresses the challenge of federated learning with extremely non-IID data by exchanging generative modules instead of discriminative parameters. This approach synthesizes class-balanced datasets locally, eliminating gradient conflicts and the need for pretrained models. Experiments on medical imaging and CIFAR-10 demonstrate that FederatedFactory recovers centralized performance and significantly outperforms baselines under pathological heterogeneity, while also enabling exact modular unlearning.
Forget relying on pretrained models or complex aggregation schemes: FederatedFactory achieves near-centralized performance in federated learning with extreme data heterogeneity by simply swapping generative priors.
Federated Learning (FL) enables distributed optimization without compromising data sovereignty. Yet, where local label distributions are mutually exclusive, standard weight aggregation fails due to conflicting optimization trajectories. Often, FL methods rely on pretrained foundation models, introducing unrealistic assumptions. We introduce FederatedFactory, a zero-dependency framework that inverts the unit of federation from discriminative parameters to generative priors. By exchanging generative modules in a single communication round, our architecture supports ex nihilo synthesis of universally class balanced datasets, eliminating gradient conflict and external prior bias entirely. Evaluations across diverse medical imagery benchmarks, including MedMNIST and ISIC2019, demonstrate that our approach recovers centralized upper-bound performance. Under pathological heterogeneity, it lifts baseline accuracy from a collapsed 11.36% to 90.57% on CIFAR-10 and restores ISIC2019 AUROC to 90.57%. Additionally, this framework facilitates exact modular unlearning through the deterministic deletion of specific generative modules.
