Search papers, labs, and topics across Lattice.
The paper introduces two novel marginal-difference contribution scores, Fair-Private and Everybody-Else, designed for private and robust contribution evaluation in cross-silo federated learning settings using secure aggregation. These scores address the limitations of existing methods like Shapley values (incompatible with secure aggregation) and Leave-One-Out (vulnerable to manipulation and self-evaluation bias). The proposed scores offer theoretical guarantees for fairness, privacy, robustness, and computational efficiency, and are empirically validated on medical imaging datasets and CIFAR10, demonstrating improved performance in client ranking, model performance, and misbehavior detection compared to baselines.
Current federated learning contribution metrics are easily manipulated, but this work introduces a new approach that's both private and robust, preventing clients from gaming the system.
Cross-silo federated learning allows multiple organizations to collaboratively train machine learning models without sharing raw data, but client updates can still leak sensitive information through inference attacks. Secure aggregation protects privacy by hiding individual updates, yet it complicates contribution evaluation, which is critical for fair rewards and detecting low-quality or malicious participants. Existing marginal-contribution methods, such as the Shapley value, are incompatible with secure aggregation, and practical alternatives, such as Leave-One-Out, are crude and rely on self-evaluation. We introduce two marginal-difference contribution scores compatible with secure aggregation. Fair-Private satisfies standard fairness axioms, while Everybody-Else eliminates self-evaluation and provides resistance to manipulation, addressing a largely overlooked vulnerability. We provide theoretical guarantees for fairness, privacy, robustness, and computational efficiency, and evaluate our methods on multiple medical image datasets and CIFAR10 in cross-silo settings. Our scores consistently outperform existing baselines, better approximate Shapley-induced client rankings, and improve downstream model performance as well as misbehavior detection. These results demonstrate that fairness, privacy, robustness, and practical utility can be achieved jointly in federated contribution evaluation, offering a principled solution for real-world cross-silo deployments.
