Search papers, labs, and topics across Lattice.
This research explores the integration of approximate computing techniques within floating point multipliers in Weight Stationary Systolic Arrays, specifically targeting IEEE 754 (FP32), TensorFloat-32 (TF32), and Brain Floating point (BF16) formats. By employing NSGA-II optimization to refine the design space, the study achieves significant hardware improvements, including footprint savings of 66% to 92% and power reductions of 60% to 93%, while maintaining competitive CNN accuracy across various datasets. The findings underscore the potential of precision-aware variable bit processing elements to enhance the efficiency of hardware accelerators for applications that can tolerate some error, thereby optimizing resource utilization in modern computing architectures.
Targeted approximation in floating point multipliers can yield up to 92% hardware footprint savings without sacrificing CNN accuracy.
Systolic arrays (SAs) have emerged as prominent hardware accelerators for matrix operations in deep learning, while floating point number formats enable precision control across computational domains. This research investigates approximate computing techniques for floating point (FP) multipliers in Weight Stationary Systolic Arrays, focusing on IEEE 754 (FP32), TensorFloat-32 (TF32), and Brain Floating point (BF16) formats. By integrating partial product matrix (PPM) column truncation with positive and negative compressors in the FP multiplier architecture, we optimize the trade-off between computational efficiency and accuracy. NSGA-II optimization algorithm was employed to explore the vast design space for evolving FP multiplier designs, towards achieving substantial hardware improvements while maintaining acceptable output quality. Substantial hardware benefits were observed in the FP multiplier designs across various applications, while preserving output quality. The FP approximated Processing Elements designed in the SA was found to offer comparable CNN accuracy for models trained on MNIST, F-MNIST, and CIFAR-10 dataset. The FP approximated SA designs that fall in the top 10 CNN performance offered substantial hardware gains in the range of 66% to 92% footprint savings, 60% to 93% of power benefits with 21% to 54% improvement in the delay when compared with the corresponding exact implementations mentioned in the literature for running the model trained on CIFAR-10 dataset. The TF32 and BF16 approximated SA designs also achieved substantial gains while maintaining comparable CNN accuracy. Our findings confirm that targeted approximation in FP multiplier design significantly improves the efficiency of hardware accelerators for error-tolerant applications, establishing an effective approach to hardware resource optimization in contemporary computing architectures.
