Search papers, labs, and topics across Lattice.
The paper addresses the inefficiency of existing incentive mechanisms in differentially private federated learning (DP-FL) that arise from compensating all clients equally, including privacy stragglers. They introduce JSAM, a Bayesian-optimal framework that jointly optimizes client selection probabilities and privacy compensation to maximize training effectiveness under a budget. JSAM transforms a high-dimensional optimization problem into a tractable three-dimensional one, demonstrating that servers should prioritize privacy-tolerant clients and revealing that low-sensitivity clients can incur high cumulative costs.
Servers in differentially private federated learning should strategically select clients based on privacy sensitivity, even if it means excluding some participants, to maximize training effectiveness and cost efficiency.
Differentially private federated learning faces a fundamental tension: privacy protection mechanisms that safeguard client data simultaneously create quantifiable privacy costs that discourage participation, undermining the collaborative training process. Existing incentive mechanisms rely on unbiased client selection, forcing servers to compensate even the most privacy-sensitive clients ("privacy stragglers"), leading to systemic inefficiency and suboptimal resource allocation. We introduce JSAM (Joint client Selection and privacy compensAtion Mechanism), a Bayesian-optimal framework that simultaneously optimizes client selection probabilities and privacy compensation to maximize training effectiveness under budget constraints. Our approach transforms a complex 2N-dimensional optimization problem into an efficient three-dimensional formulation through novel theoretical characterization of optimal selection strategies. We prove that servers should preferentially select privacy-tolerant clients while excluding high-sensitivity participants, and uncover the counter-intuitive insight that clients with minimal privacy sensitivity may incur the highest cumulative costs due to frequent participation. Extensive evaluations on MNIST and CIFAR-10 demonstrate that JSAM achieves up to 15% improvement in test accuracy compared to existing unbiased selection mechanisms while maintaining cost efficiency across varying data heterogeneity levels.
