Search papers, labs, and topics across Lattice.
This paper introduces FB-NLL, a feature-based framework for personalized federated learning that addresses the challenge of noisy labels by decoupling user clustering from iterative training dynamics. FB-NLL characterizes users based on the spectral structure of feature representation covariances and uses subspace similarity for task-consistent user grouping, enabling label-agnostic clustering. They further introduce a feature-consistency-based detection and correction strategy to mitigate noisy labels within clusters by leveraging directional alignment in the learned feature space.
By clustering users based on the geometry of their feature spaces *before* training, FB-NLL sidesteps the vulnerability of existing federated learning methods to noisy labels and corrupted updates.
Personalized Federated Learning (PFL) aims to learn multiple task-specific models rather than a single global model across heterogeneous data distributions. Existing PFL approaches typically rely on iterative optimization-such as model update trajectories-to cluster users that need to accomplish the same tasks together. However, these learning-dynamics-based methods are inherently vulnerable to low-quality data and noisy labels, as corrupted updates distort clustering decisions and degrade personalization performance. To tackle this, we propose FB-NLL, a feature-centric framework that decouples user clustering from iterative training dynamics. By exploiting the intrinsic heterogeneity of local feature spaces, FB-NLL characterizes each user through the spectral structure of the covariances of their feature representations and leverages subspace similarity to identify task-consistent user groupings. This geometry-aware clustering is label-agnostic and is performed in a one-shot manner prior to training, significantly reducing communication overhead and computational costs compared to iterative baselines. Complementing this, we introduce a feature-consistency-based detection and correction strategy to address noisy labels within clusters. By leveraging directional alignment in the learned feature space and assigning labels based on class-specific feature subspaces, our method mitigates corrupted supervision without requiring estimation of stochastic noise transition matrices. In addition, FB-NLL is model-independent and integrates seamlessly with existing noise-robust training techniques. Extensive experiments across diverse datasets and noise regimes demonstrate that our framework consistently outperforms state-of-the-art baselines in terms of average accuracy and performance stability.
