Search papers, labs, and topics across Lattice.
This paper introduces HASTE, a novel framework that enables training-free, dynamic compression of pre-trained convolutional neural networks (CNNs) using locality-sensitive hashing to merge redundant channels at inference time. By applying this method, the authors achieve a significant 46.2% reduction in FLOPs for ResNet34 on CIFAR-10 with only a 1.25% drop in accuracy, showcasing the framework's efficiency without the need for retraining. The extensive experiments and ablation studies validate HASTE's effectiveness and its potential to enhance the deployment of deep learning models on resource-constrained devices.
Achieving a 46.2% reduction in computational cost for CNNs without retraining could revolutionize how we deploy deep learning on edge devices.
Deploying large convolutional neural networks (CNNs) on resource-constrained devices is challenging due to their high computational cost. While dynamic execution methods are promising, existing approaches for CNNs typically require specialized training or fine-tuning, limiting their effectiveness when applied to pre-trained models and requiring data access. To address this gap, we propose HASTE (Hashing for Tractable Efficiency), a plug-and-play convolution module that enables training-free, dynamic compression of large pre-trained CNNs. At inference time, HASTE uses locality-sensitive hashing to identify and merge redundant channels of latent feature maps on a patch-wise basis. This process simultaneously compresses the depth of both input features and their corresponding filters, resulting in computationally cheaper convolutions. We conduct extensive experiments on CIFAR-10 and ImageNet across a range of architectures, demonstrating a 46.2% FLOPs reduction in a ResNet34 on CIFAR-10 with only a 1.25% drop in accuracy, without any retraining. We support our claims by comprehensive ablation studies to validate our core design choices, an analysis of the method's properties and limitations, and a discussion that connects our channel merging scheme to the conceptually related task of token merging in Vision Transformers. Our results demonstrate that HASTE provides an effective solution for steerable compression of pre-trained CNNs at runtime, opening new possibilities for the deployment of efficient deep learning methods.
