Search papers, labs, and topics across Lattice.
The paper introduces FedHarmony, a federated multi-label learning framework designed to mitigate label correlation drift caused by heterogeneous data distributions across clients. FedHarmony uses a consensus correlation mechanism, where clients learn from a global teacher representing agreement among other clients, thereby correcting biased local estimates of label correlations. The framework also incorporates a weighted aggregation scheme based on both data size and correlation quality, and an accelerated optimization algorithm with provable convergence guarantees.
Federated learning can overcome data silos, but struggles when clients have different label relationships; FedHarmony shows how to harmonize these differences, leading to better performance.
Federated Multi-Label Learning is a distributed paradigm where multiple clients possess heterogeneous multi-label data and perform collaborative learning under privacy constraints without sharing raw data. However, modeling label correlations under heterogeneous distributions remains challenging. Due to client-specific label spaces and varying co-occurrence patterns, correlations learned by individual clients inevitably deviate from the global structure, a phenomenon we term label correlation drift. To address this, we propose FedHarmony, a framework that harmonizes heterogeneous label correlations across clients. It introduces consensus correlation, capturing agreement among other clients and serving as a global teacher to correct biased local estimates. During aggregation, FedHarmony evaluates each client by both data size and correlation quality, assigning weights accordingly. Moreover, we develop an accelerated optimization algorithm for FedHarmony and theoretically establish faster convergence without sacrificing accuracy. Experiments on real-world federated multi-label datasets show that FedHarmony consistently outperforms state-of-the-art methods.
Tsinghua AI