Search papers, labs, and topics across Lattice.
This paper introduces FRAMP, a federated learning framework that generates client-specific models from compact descriptors, enabling fine-grained adaptation to data characteristics and computational budgets without relying on a fixed global backbone. FRAMP trains lightweight submodels on each client and aligns their learned representations to maintain global semantic consistency. Experiments on vision and graph benchmarks show that FRAMP improves generalization and adaptivity across diverse client settings compared to methods relying on a shared global model.
Ditch the monolithic FL model: FRAMP generates personalized models from compact client descriptors, boosting generalization and adaptivity across diverse client settings.
In federated learning (FL), accommodating clients with diverse resource constraints remains a significant challenge. A widely adopted approach is to use a shared full-size model, from which each client extracts a submodel aligned with its computational budget. However, regardless of the specific scoring strategy, these methods rely on the same global backbone, limiting both structural diversity and representational adaptation across clients. This paper presents FRAMP, a unified framework for personalized and resource-adaptive federated learning. Instead of relying on a fixed global model, FRAMP generates client-specific models from compact client descriptors, enabling fine-grained adaptation to both data characteristics and computational budgets. Each client trains a tailored lightweight submodel and aligns its learned representation with others to maintain global semantic consistency. Extensive experiments on vision and graph benchmarks demonstrate that FRAMP enhances generalization and adaptivity across a wide range of client settings.