Search papers, labs, and topics across Lattice.
This paper introduces TECO, a multi-dimensional pruning framework designed to enhance the efficiency of convolutional neural networks (CNNs) on embedded hardware by simultaneously pruning depth, width, and resolution. The authors implement a two-stage importance evaluation framework that assesses both local and global importance of pruning units, leading to a heuristic algorithm that optimally balances accuracy and efficiency. Experimental results demonstrate that TECO outperforms existing state-of-the-art methods across various benchmarks, highlighting its practical applicability in resource-constrained environments.
TECO achieves a groundbreaking balance between accuracy and efficiency by pruning CNNs across multiple dimensions, setting a new standard for embedded hardware performance.
In this paper, we propose TECO, a multi-dimensional pruning framework to collaboratively prune the three dimensions (depth, width, and resolution) of convolutional neural networks (CNNs) for better execution efficiency on embedded hardware. In TECO, we first introduce a two-stage importance evaluation framework, which efficiently and comprehensively evaluates each pruning unit according to both the local importance inside each dimension and the global importance across different dimensions. Based on the evaluation framework, we present a heuristic pruning algorithm to progressively prune the three dimensions of CNNs towards the optimal trade-off between accuracy and efficiency. Experiments on multiple benchmarks validate the advantages of TECO over existing state-of-the-art (SOTA) approaches. The code and pre-trained models are available at https://github.com/ntuliuteam/Teco.
