Search papers, labs, and topics across Lattice.
This study explores the use of reduced-precision floating-point arithmetic for FFT-based CNN inference on an industrial CPU-FPGA platform, focusing on adaptive post-training FP8 quantization. By implementing progressive bias adjustment and layer-wise exponent-bias selection, the authors enhance the accuracy of a LeNet-5 accelerator from 80.33% to 84.13% while maintaining the same datapath width. The results demonstrate that the FPGA implementation achieves approximately 2.5 times higher energy efficiency compared to traditional CPU-only inference.
Achieving a 4% accuracy boost in CNNs without changing datapath width while enhancing energy efficiency by 2.5x could revolutionize industrial visual inspection.
This paper investigates reduced-precision floating-point arithmetic for FFT-based CNN inference on an industrial CPU-FPGA platform. We combine FFT-based convolution with adaptive post-training FP8 quantization and evaluate two FPGA-oriented optimization methods: progressive bias adjustment (PBA) within the FFT and layer-wise exponent-bias selection across the CNN. The methods are implemented in a LeNet-5 accelerator using serial radix-$2^2$ SDF FFT modules and evaluated on an industrial fault detection dataset. Results show that weight scaling outperforms PBA, while layer-wise bias optimization increases the accuracy from 80.33% to 84.13% without modifying the datapath width. Compared with CPU-only inference, the FPGA achieves approximately 2.5$\times$ higher energy efficiency.
