Search papers, labs, and topics across Lattice.
This paper introduces HADES, a novel framework for privacy-preserving federated learning that selectively encrypts only the most privacy-sensitive features while allowing the rest of the data to remain unencrypted. By employing Principal Component Analysis (PCA) to identify critical features and integrating encrypted and plaintext model training through a hybrid fusion mechanism, HADES significantly reduces the risk of reconstruction attacks without incurring the high computational costs typical of fully encrypted systems. The results show that HADES achieves comparable accuracy to traditional federated learning methods while enhancing privacy and optimizing runtime efficiency.
Selective feature encryption in federated learning can maintain model accuracy while drastically reducing privacy risks and computational overhead.
In this paper, we address the challenge of privacy-preserving training in federated learning (FL) by introducing a novel framework that selectively encrypts only the most privacy-sensitive features while leaving the remaining data and the corresponding model portion unencrypted. We propose HADES, a hybrid system that identifies and encrypts the most critical features, ensuring both privacy protection and computational efficiency. Unlike fully encrypted FL training pipelines, which suffer from high computational overhead, HADES integrates an encrypted and non-encrypted training pipeline via a fusion mechanism, enabling seamless interaction between encrypted and plaintext model representations. To achieve this, we use PCA to identify and encrypt the most privacy-sensitive features, which significantly reduces reconstruction attack success in FL. Building on this insight, we design a hybrid FL system that trains an end-to-end encrypted network via multiparty homomorphic encryption (MHE) on the selected features while simultaneously training a plaintext network on the remaining features. These two networks are then integrated using a fusion mechanism. We also introduce a general packing scheme that eliminates redundant rotations by considering the entire neural network architecture. Finally, we demonstrate that HADES matches the accuracy of vanilla FL while preserving privacy and achieving optimized runtime through selective encryption.
