Search papers, labs, and topics across Lattice.
This paper introduces DataGuard, a hardware-based mechanism that ensures compliance with differential privacy (DP) requirements during federated learning (FL) by preventing sensitive data from being exposed to third-party applications. The significance lies in its ability to maintain privacy guarantees without relying on the trustworthiness of external applications, addressing a critical vulnerability in current FL implementations. Evaluation across four accelerators shows that DataGuard incurs minimal area overheads and performance slowdowns, making it a practical solution for secure ML training.
DataGuard ensures that sensitive data remains private during federated learning, even when third-party applications are involved.
Differential privacy (DP) and federated learning (FL) have emerged as important privacy-preserving approaches when using sensitive data to train machine learning (ML) models. FL ensures that raw sensitive data does not leave the users' devices by training the model locally on the device. DP ensures that the model does not leak any information about an individual by clipping and adding noise to the gradients before updating the model. It provides formalism to constrain privacy loss during training to a privacy budget determined a priori by the owner of sensitive data. However, real-life deployments of FL algorithms typically assume that a third-party FL application can be trusted to correctly implement DP algorithms. Thus, the third-party application is given full access to sensitive data. In this work, we propose DataGuard, a hardware-based mechanism that guarantees that the only data that can leave the device is the result of computation that meets DP requirements. DataGuard can thus be used to ensure that the privacy budget defined by the data owner is not exceeded during FL training without the need to trust a third-party application. We evaluate DataGuard in simulations of four accelerators for various ML models and demonstrate only small area overheads of less than 0.01\% and performance slowdowns of less than 0.3\%.
