Search papers, labs, and topics across Lattice.
This paper introduces SLOT-Align, a novel framework for One-Shot Federated Learning (OSFL) that addresses the challenges posed by heterogeneous client data distributions, specifically domain and label shifts. By utilizing a shared frozen encoder and Bures-Wasserstein barycenters, SLOT-Align harmonizes feature representations through geodesic optimal transport maps, enabling effective alignment without iterative optimization. Experimental results demonstrate that SLOT-Align significantly enhances accuracy and robustness in OSFL scenarios, outperforming existing methods that either assume aligned representations or tackle shifts separately.
SLOT-Align achieves superior accuracy and robustness in One-Shot Federated Learning by harmonizing feature representations in the presence of domain and label shifts.
One-Shot Federated Learning (OSFL) addresses extreme communication regimes in which clients interact with the server only once, amplifying the impact of heterogeneous client data distributions. In particular, the interaction of domain shift and label shift across clients induces misaligned feature representations that cannot be corrected through iterative optimization. Existing OSFL methods rely on distillation, server-side generation or ensemble-based aggregation, but assume aligned representations or address domain and label shift separately. We introduce SLOT-Align (Single-round, Learning-free Optimal Transport Alignment), a geometry-aware feature harmonization framework for OSFL. SLOT-Align uses a shared frozen encoder to extract compact feature statistics, constructs a global reference via Bures-Wasserstein barycenters, and aligns local representations using closed-form geodesic optimal transport maps. The method is computationally efficient and can be combined with existing OSFL pipelines relying on frozen encoders without modifying their training procedures. Extensive experiments across multiple benchmarks, pretrained backbones, and OSFL methods show that SLOT-Align consistently improves accuracy and robustness under joint domain and label shift.
