Search papers, labs, and topics across Lattice.
HiReLC introduces a hierarchical ensemble-reinforcement learning framework that automates the joint quantization and structured pruning of deep neural networks. By employing low-level agents to optimize configurations at a granular level and high-level agents for global budget coordination, the method achieves significant compression ratios while maintaining competitive accuracy. Experimental results show parameter-storage reductions of 5.99 - 6.72脳 with minimal accuracy drops, validating the effectiveness of hierarchical policy decomposition and sensitivity-aware guidance in neural network compression.
Achieving up to 6.72脳 compression with only minor accuracy trade-offs, HiReLC revolutionizes how we approach neural network optimization.
We present HiReLC, a hierarchical ensemble-reinforcement learning framework for automated joint quantization and structured pruning of deep neural networks. The framework decomposes the compression search across two levels of abstraction: low-level agents (LLAs) operate independently per block, selecting per-kernel configurations over a multi-discrete action space spanning bitwidth, pruning keep-ratio, quantization type, and granularity, while high-level agents (HLAs) coordinate global budget allocation via ensemble voting guided by Fisher Information-based sensitivity estimates. To mitigate the computational cost of policy evaluation, an iterative active learning loop interleaves surrogate-guided RL optimization with post-compression fine-tuning, using a lightweight MLP surrogate to amortize expensive evaluations and a logit-MSE proxy during cold-start. The surrogate is used for reward shaping rather than as a replacement for final post-compression evaluation. The controller is architecture-agnostic by design, with a modular layer abstraction decoupling the RL environment from the underlying network topology. Experiments across Vision Transformer and CNN benchmarks demonstrate effective parameter-storage compression ratios of 5.99 - 6.72$\times$ with a 3.83 % gain in one setting and 0.55 - 5.62 % accuracy drops elsewhere, supporting hierarchical policy decomposition and sensitivity-aware guidance as practical design choices for joint neural network compression.
