Search papers, labs, and topics across Lattice.
This paper introduces a novel framework for assessing privacy through the lens of predictability, which quantifies the incremental gain in an attacker's ability to infer sensitive information after observing algorithm outputs. The authors demonstrate that predictability and differential privacy (DP) are generally incomparable, revealing scenarios where one can be minimal while the other is substantial, particularly in worst-case situations. By employing the generalized method of moments (GMM), they derive a predictability-calibrated output perturbation scheme that enhances privacy control while remaining compatible with existing DP measures.
Predictability reveals that privacy can be finely tuned beyond traditional differential privacy, allowing for tailored privacy metrics based on specific attacker models.
Differential privacy (DP) ensures rigorous individual-level privacy guarantees against even the most knowledgeable attackers, but its worst-case nature can impose a costly privacy-accuracy tradeoff. We introduce privacy via predictability, a fine-grained framework that explicitly incorporates the attacker's core knowledge, a compromised portion of the dataset generated by a stochastic process, and a specified family of queries. Predictability measures privacy leakage as the incremental gain in an attacker's ability to predict sensitive information about unknown individuals after observing the algorithm's output, beyond what can already be inferred from the compromised data. We show that predictability and DP are generally incomparable: each can be small while the other is large. However, in the worst-case regime where all but one individual is compromised, and all binary queries are considered sensitive, predictability implies mutual-information DP. More generally, predictability provides a finer-grained privacy metric tailored to specific sensitive information and specific attacker models. We introduce a general framework, using the generalized method of moments (GMM), to analyze asymptotic predictability when the compromised data is generated by a stationary, ergodic, mixing process. Using this analysis, we derive a predictability-calibrated output perturbation scheme for ERM. Our approach is complementary to DP and can be used alongside DP to provide fine-grained privacy control.
