Search papers, labs, and topics across Lattice.
This paper investigates the differential privacy of posterior sample paths from Gaussian processes (GPs) when the training data is kept private. By deriving explicit R茅nyi-DP bounds, the authors reveal how the intrinsic randomness of posterior sampling can provide privacy guarantees, while also highlighting the critical role of effective ridge regularization in mitigating data leakage. Empirical tests demonstrate that privacy-preserving regularization can maintain utility in downstream tasks, and additional calibrated noise can enhance privacy when necessary.
Intrinsic randomness in Gaussian process sampling can yield strong differential privacy guarantees, challenging conventional noise addition methods.
We study the privacy of releasing posterior sample paths from a Gaussian process (GP) when the entire training set including covariates and responses is private. Unlike standard differential-privacy (DP) mechanisms that add external noise, posterior sampling is random by construction. We show that this intrinsic randomness yields DP guarantees by deriving explicit R茅nyi-DP bounds for GP posterior sample-path release. The bounds separate posterior-mean leakage from data-dependent posterior-covariance leakage showing that meaningful privacy depends sharply on effective ridge regularisation. We apply membership-inference attacks to show that empirical leakage follows the predicted dependence on regularisation, posterior variance and the number of released posterior sample-paths. Utility experiments on downstream posterior-sampling tasks identify noisy-observation regimes where privacy-compatible regularisation preserves useful decisions with modest utility loss. When stronger privacy is needed, the intrinsic guarantee can be sharpened by adding calibrated GP noise, providing an explicit additional privacy knob.
