Search papers, labs, and topics across Lattice.
This paper introduces a novel multi-precision systolic array architecture that integrates full-precision output reconstruction directly within the array, allowing for seamless low-precision matrix multiplication. By addressing the precision mismatch between Fully Homomorphic Encryption (FHE) requirements and AI hardware capabilities, the proposed design eliminates the need for offloading computations, which previously created performance bottlenecks. Cycle-accurate simulations reveal that this architecture achieves a minimum of 1.33x speedup for Number Theoretic Transform (NTT) computations on standard AI hardware, significantly enhancing the feasibility of high-precision FHE acceleration.
Achieving a 1.33x speedup in FHE NTT computations on standard AI hardware could revolutionize the efficiency of privacy-preserving applications.
Fully Homomorphic Encryption (FHE) ensures robust data privacy but suffers from prohibitive computational overhead. Accelerating FHE on AI hardware like Tensor Processing Units (TPUs) is promising, yet fundamentally limited by a precision mismatch: TPUs are optimized for 8-bit arithmetic, whereas FHE and its critical parts such as the Number Theoretic Transform (NTT), demand high precision. Current approaches bridge this gap using matrix decomposition to execute NTT computations on low-precision matrix engines. However, reconstructing the full-precision results requires shift-and-add accumulation that does not match the dataflow of matrix multiplication. This forces offloading full-precision reconstruction from matrix engines to vector processors that disrupts the matrix multiplication dataflow, creating significant performance bottleneck. To resolve this limitation, we propose a minimally modified multi-precision systolic array that performs full-precision output reconstruction natively within the array in sync with low-precision matrix multiplication under a uniform dataflow. Synthesized at 7nm with OpenRoad, our design incurs negligible hardware overhead. Cycle-accurate simulations using SCALE-Sim demonstrate that natively executing NTTs on the proposed architecture achieves at least 1.33x speedup, for transform sizes 2^12 to 2^16 on 128x128 matrix engines, successfully enabling standard AI hardware to support high-precision FHE acceleration.
