Search papers, labs, and topics across Lattice.
FedCova is introduced as a federated learning framework designed to enhance model robustness against noisy labels by encoding data into a discriminative feature space using feature covariances. The method maximizes mutual information through a novel objective for federated lossy feature encoding, relying on class feature covariances with an error tolerance term. By constructing a subspace-augmented federated classifier, FedCova demonstrates superior robustness compared to existing methods on CIFAR-10/100 and Clothing1M datasets under both symmetric and asymmetric noisy label settings.
FedCova sidesteps the need for clean data in federated learning by directly encoding robustness to noisy labels into the model itself via feature covariance learning.
Noisy labels in distributed datasets induce severe local overfitting and consequently compromise the global model in federated learning (FL). Most existing solutions rely on selecting clean devices or aligning with public clean datasets, rather than endowing the model itself with robustness. In this paper, we propose FedCova, a dependency-free federated covariance learning framework that eliminates such external reliances by enhancing the model's intrinsic robustness via a new perspective on feature covariances. Specifically, FedCova encodes data into a discriminative but resilient feature space to tolerate label noise. Built on mutual information maximization, we design a novel objective for federated lossy feature encoding that relies solely on class feature covariances with an error tolerance term. Leveraging feature subspaces characterized by covariances, we construct a subspace-augmented federated classifier. FedCova unifies three key processes through the covariance: (1) training the network for feature encoding, (2) constructing a classifier directly from the learned features, and (3) correcting noisy labels based on feature subspaces. We implement FedCova across both symmetric and asymmetric noisy settings under heterogeneous data distribution. Experimental results on CIFAR-10/100 and real-world noisy dataset Clothing1M demonstrate the superior robustness of FedCova compared with the state-of-the-art methods.
