Search papers, labs, and topics across Lattice.
This paper introduces a resource-oriented one-shot quantiser pruning method that optimizes neural networks for FPGA-based applications by directly targeting the desired resource levels. By employing bidirectional beta scheduling for fine-tuning, the approach significantly reduces the computational cost of exploring the Pareto frontier, achieving up to 20.58 times less search cost compared to traditional methods. The method maintains competitive performance on the jet substructure classification task, demonstrating its effectiveness in balancing accuracy and hardware utilization.
Achieving a 20.58x reduction in search cost for optimal neural network configurations on FPGAs could revolutionize resource-efficient AI deployment at the edge.
High granularity quantisation (HGQ) exploits weight-level quantisation and pruning to design resource-efficient neural network accelerators, achieving an attractive trade-off between accuracy and hardware utilisation. HGQ is particularly well suited to FPGA-based edge neural network applications. Standard HGQ workflow starts from a high-precision model and progressively reduces bit width, guided by gradient-based optimisation to outline the Pareto frontier. This monotonic and irreversible pruning process is computationally intensive and can overlook the optimal subnetwork for a given resource level. We propose a resource-oriented one-shot quantiser pruning method that brings the network directly close to the target search space, and then use bidirectional beta scheduling for fine-tuning to enable a more refined scan of the Pareto frontier. Validated on the jet substructure classification, JSC, task, our method reduces the search cost by up to 20.58x compared with monotonic resource reduction in standard HGQ workflows, while achieving a competitive Pareto frontier and final network configuration.
