Search papers, labs, and topics across Lattice.
The paper introduces Bonsai, a framework for criterion-based CNN pruning that facilitates the implementation and comparison of different pruning criteria. The authors demonstrate Bonsai's effectiveness through iterative pruning experiments on VGG-inspired models, achieving up to 79% filter reduction while maintaining or improving accuracy. They also propose novel criterion functions and establish a standardized language for comparing these functions.
Pruning CNNs just got easier: Bonsai offers a unified framework to compare and implement different pruning criteria, achieving significant compression with minimal accuracy loss.
As the need for more accurate and powerful Convolutional Neural Networks (CNNs) increases, so too does the size, execution time, memory footprint, and power consumption. To overcome this, solutions such as pruning have been proposed with their own metrics and methodologies, or criteria, for how weights should be removed. These solutions do not share a common implementation and are difficult to implement and compare. In this work, we introduce Combine, a criterion- based pruning solution and demonstrate that it is fast and effective framework for iterative pruning, demonstrate that criterion have differing effects on different models, create a standard language for comparing criterion functions, and propose a few novel criterion functions. We show the capacity of these criterion functions and the framework on VGG inspired models, pruning up to 79\% of filters while retaining or improving accuracy, and reducing the computations needed by the network by up to 68\%.
