Search papers, labs, and topics across Lattice.
This paper introduces VARA, a voltage-aware ReRAM-based accelerator designed to enhance energy efficiency in in-memory computing by leveraging activation sparsity. The authors present a novel voltage-aware training (VAT) algorithm that optimizes activation distributions and a co-zero activation reordering (CAR) scheme that maximizes computation skipping by clustering zero activations. Experimental results show that VARA achieves a 60.12% reduction in energy consumption and a 2.68x improvement in energy efficiency with minimal accuracy loss, outperforming existing accelerators in sparse-activation scenarios.
VARA slashes energy consumption by over 60% while maintaining accuracy, revolutionizing how we utilize activation sparsity in ReRAM architectures.
ReRAM-based in-memory computing (IMC) architectures are widely regarded as a promising approach to alleviating the computational bottleneck of conventional architectures. Since ReRAM crossbars perform matrix-vector multiplication (MVM) in the analog domain, their computational energy consumption is highly dependent on weight and activation distributions. However, most existing ReRAM accelerators focus primarily on weight optimization while paying limited attention to the impact of activations on computational energy consumption, leaving the energy-saving potential of activation sparsity largely underexploited. In this paper, we propose a voltage-aware ReRAM-based accelerator (VARA), along with its accompanying design methodology. Specifically, we first introduce a voltage-aware training (VAT) algorithm that incorporates a preset threshold into the activation function to steer the activation distribution toward zero values, thereby enhancing activation sparsity. Building upon this, we further propose a co-zero activation reordering (CAR) scheme for crossbar-level computation skipping. CAR clusters activation dimensions based on their co-zero correlations and consistently reorders both the activation matrix and its corresponding weights. This process consolidates scattered zero activations into contiguous zero-valued regions to maximize the benefits of crossbar-level computation skipping. Extensive experimental results demonstrate that, with only marginal accuracy loss, VARA reduces the average total system energy consumption by 60.12\% and improves the average system energy efficiency by 2.68$\times$ compared to the baseline, outperforming existing state-of-the-art accelerators for sparse-activation optimization.
