Search papers, labs, and topics across Lattice.
The paper addresses the bias introduced by noninteractive Local Differential Privacy (LDP) when releasing data for binary classification tasks. They characterize this bias using the Weierstrass transform and propose a bias-correction method based on inverting this transform to obtain unbiased estimates of nonlinear functions on LDP-released examples. The authors then introduce Inverse Weierstrass Private SGD (IWP-SGD), a novel stochastic gradient descent algorithm that provably converges to the true population risk minimizer at a rate of $\mathcal{O}(1/n)$.
Overcome the bias introduced by local differential privacy with a new SGD algorithm that converges to the true population risk minimizer.
Releasing data once and for all under noninteractive Local Differential Privacy (LDP) enables complete data reusability, but the resulting noise may create bias in subsequent analyses. In this work, we leverage the Weierstrass transform to characterize this bias in binary classification. We prove that inverting this transform leads to a bias-correction method to compute unbiased estimates of nonlinear functions on examples released under LDP. We then build a novel stochastic gradient descent algorithm called Inverse Weierstrass Private SGD (IWP-SGD). It converges to the true population risk minimizer at a rate of $\mathcal{O}(1/n)$, with $n$ the number of examples. We empirically validate IWP-SGD on binary classification tasks using synthetic and real-world datasets.
