Search papers, labs, and topics across Lattice.
This paper presents a GPU-accelerated implementation of sparse matrix multiplication for fully homomorphic encrypted (FHE) deep neural networks using the FIDESlib library. By exploiting sparsity in both operands, the authors achieve a $3.0\times$ speedup compared to CPU implementations. The optimized approach also reduces the time complexity of ciphertext matmul from cubic to semi-linear.
Sparsity unlocks surprisingly practical GPU acceleration for fully homomorphic encrypted neural networks, achieving a 3x speedup and sub-quadratic complexity.
Fully homomorphic encryption (FHE) has recently attracted significant attention as both a cryptographic primitive and a systems challenge. Given the latest advances in accelerated computing, FHE presents a promising opportunity for progress, with applications ranging from machine learning to information security. We target the most computationally intensive operation in deep neural networks from a hardware perspective, matrix multiplication (matmul), and adapt it for execution on AMD GPUs. We propose a new optimized method that improves the runtime and complexity of ciphertext matmul by using FIDESlib, a recent open-source FHE library designed specifically for GPUs. By exploiting sparsity in both operands, our sparse matmul implementation outperforms its CPU counterpart by up to $3.0\times$ and reduces the time complexity from cubic to semi-linear, demonstrating an improvement over existing FHE matmul implementations.
