Search papers, labs, and topics across Lattice.
This paper introduces a novel delta compression technique for deep neural networks (DNNs) aimed at optimizing weight storage on resource-constrained FPGAs. By utilizing two delta schemes鈥攃onsecutive deltas and deltas with a fixed-reference value鈥攖he authors demonstrate that fixed-reference delta compression significantly reduces memory usage while maintaining competitive validation accuracy. The approach achieves a 50% weight compression and a throughput of 7.992M MACs/s, marking a substantial improvement in efficiency for embedded DNN applications.
Fixed-reference delta compression achieves nearly 50% weight reduction while only sacrificing 8.3% accuracy, revolutionizing DNN deployment on FPGAs.
The deployment of embedded deep neural networks on resource-constrained field programmable gate arrays (FPGAs) is challenging due to limited memory and computational capacities. We introduce a new compression technique to reduce the memory footprint by saving weights in deltas with lower bitwidth and training the network to cope with compressed deltas. Two delta schemes are investigated: consecutive deltas and deltas with a fixed-reference value. We evaluate both on the FashionMNIST data set with a multi-layer-perceptron. The results indicate that fixed-reference delta compression outperforms the consecutive variant, achieving a validation accuracy of approximately 78.6 %, with 4 bit weight deltas, representing an accuracy loss of roughly 8.3 % compared to a fixed-point network with 8 bit. Our specialized hardware accelerator with a delta-compressed multiply-and-accumulate operator compresses weights by nearly 50 % and achieves a maximum throughput of 7.992M MACs/s on an AMD Spartan-7 S15 FPGA.
