Search papers, labs, and topics across Lattice.
This paper introduces range regularization for federated learning, enhancing statistical accuracy and promoting cross-client regularity through a novel method called polar clustering, which adaptively clusters personalized features at extreme values. Theoretical analysis reveals significant challenges due to the seminorm nature of the regularizer, prompting the development of new proof techniques for nonasymptotic analysis and pattern recovery. Experimental results demonstrate that the proposed optimization algorithm effectively reduces iteration complexity while maintaining performance, showcasing its potential for practical applications in federated learning scenarios.
Range regularization in federated learning can significantly improve statistical accuracy and resource efficiency by clustering extreme feature values across clients.
This paper introduces range regularization for federated learning with linear systematic components to enhance statistical accuracy and induce cross-client regularity conducive to quantization, coding, and resource efficiency. Our approach identifies features with shared weights across different clients and adaptively clusters the weights of personalized features at extreme values, a process we refer to as polar clustering. Theoretical analysis of the associated estimators poses significant challenges due to the seminorm nature and non-decomposability of the regularizer. We develop new proof techniques for the nonasymptotic analysis of statistical accuracy and faithful pattern recovery. Moreover, a fast optimization algorithm that leverages varying degrees of local strong convexity is proposed to reduce iteration complexity. Experiments support the efficacy and efficiency of the proposed approach.
