Search papers, labs, and topics across Lattice.
This paper introduces a machine-learning-oriented instruction set architecture (ISA) and a reconfigurable hardware platform designed to enhance the efficiency and adaptability of deep neural network (DNN) accelerators. By enabling fine-grained control over data movement and dynamic precision, the architecture employs lightweight programmable cores and SIMD units to achieve high processing-element utilization with minimal control overhead. The implementation demonstrates significant performance, achieving 5.12-10.47 TOPS/W and up to 1.2x higher energy efficiency compared to fixed-point counterparts, while maintaining model accuracy and outperforming existing mixed-precision accelerators.
Achieving up to 1.2x higher energy efficiency than fixed-point accelerators, this architecture redefines the balance between efficiency and programmability in DNN hardware.
Domain-specific hardware accelerators provide significantly higher performance and energy efficiency for deep neural network (DNN) workloads than general-purpose processors, but often lack adaptability to evolving model architectures. In contrast, general-purpose ISA-based solutions, such as RISC-V-based accelerators, improve programmability at the cost of efficiency. This work addresses this tradeoff by introducing a machine-learning-oriented instruction set architecture (ISA) and a reconfigurable hardware platform that combine high efficiency with flexibility. The proposed ISA enables fine-grained control over data movement, dynamic precision, and decoupled execution across data-fetching, tensor processing, and post-processing domains. The corresponding architecture employs lightweight programmable cores and SIMD units to maintain high processing-element utilization with low control overhead, while remaining independent of the underlying numerical representation. We demonstrate the approach using a Residue Number System (RNS) instantiation supporting 3-8-bit dynamic precision. A 22-nm implementation achieves 5.12-10.47 TOPS/W for a typical workload and up to 1.2x higher energy efficiency than its fixed-point counterpart, while preserving model accuracy. It also outperforms state-of-the-art and mixed-precision accelerators. These results show that the proposed design effectively bridges the gap between efficiency and programmability in modern DNN accelerators.
