Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study explores the application of fully homomorphic encryption (FHE) to enable privacy-preserving inference tasks in computer vision, specifically through the adaptation of convolutional neural networks (CNNs) to operate directly on encrypted data. By leveraging Microsoft SEAL, the researchers modified conventional CNN architectures to maintain classification accuracy while processing encrypted images across multiple datasets, including MNIST and CIFAR-10. The results demonstrate a minimal drop in performance, indicating that privacy-preserving techniques can be effectively integrated into machine learning workflows without significant trade-offs in accuracy.
Achieving near-baseline accuracy in CNNs while performing inference on encrypted images could revolutionize how sensitive data is handled in cloud-based machine learning applications.
Legal requirements might prevent organizations from sharing sensitive data like medical or financial details of consumers which prevents them from leveraging cloud based ML-as-a-service solutions provided by third party providers, which are quickly gaining popularity these days. In this project, we aim to perform inference tasks in Computer Vision in a privacy-preserving manner, i.e, by only looking at encrypted data. Recent advances in fully homomorphic encryption make this possible. A fully homomorphic encryption allows an arbitrary sequence of additive and multiplicative operations to be performed on encrypted data directly. Applying homomorphic encryptions to CNNs requires modifying the conventional CNN layers, so that they adhere to the encryption scheme. Our aim was to explore the best methods to create CNNs which can classify encrypted images directly. We used Microsoft SEAL for performing homomorphic encryption. The performance of these "encryption based CNNs" should be comparable with baseline accuracies of the same CNNs trained on unencrypted data, and the aim was to achieve as low of a hit on inference-time performance as possible. We successfully obtained minimal drop in classification accuracy for various datasets. We used MNIST as our baseline, which is popularly used in related research work and then explored more complex datasets like Kuzushiji MNIST, Fashion-MNIST and CIFAR-10 as a part of our contribution. Additionally, we also added support for more complex operations on top of TenSEAL, like processing colored images (multi-channel input), applying multiple convolutional layers and performing average pooling.