Search papers, labs, and topics across Lattice.
This paper introduces FILCO, a flexible composing architecture for DNN acceleration that addresses the hardware-workload mismatch problem in heterogeneous computing platforms. FILCO achieves real-time reconfigurability, allowing it to be composed into unified or independent accelerators to optimize storage and computation resource efficiency for diverse workloads. Evaluated on a 7nm AMD Versal VCK190 board, FILCO demonstrates 1.3x - 5x improvement in throughput and hardware efficiency compared to prior works.
Achieve 5x better throughput and hardware efficiency on diverse DNN workloads by composing reconfigurable accelerators in real-time.
With the development of deep neural network (DNN) enabled applications, achieving high hardware resource efficiency on diverse workloads is non-trivial in heterogeneous computing platforms. Prior works discuss dedicated architectures to achieve maximal resource efficiency. However, a mismatch between hardware and workloads always exists in various diverse workloads. Other works discuss overlay architecture that can dynamically switch dataflow for different workloads. However, these works are still limited by flexibility granularity and induce much resource inefficiency. To solve this problem, we propose a flexible composing architecture, FILCO, that can efficiently match diverse workloads to achieve the optimal storage and computation resource efficiency. FILCO can be reconfigured in real-time and flexibly composed into a unified or multiple independent accelerators. We also propose the FILCO framework, including an analytical model with a two-stage DSE that can achieve the optimal design point. We also evaluate the FILCO framework on the 7nm AMD Versal VCK190 board. Compared with prior works, our design can achieve 1.3x - 5x throughput and hardware efficiency on various diverse workloads.
