Search papers, labs, and topics across Lattice.
This paper introduces AIA, a specialized 16nm multicore System-on-Chip (SoC) designed to accelerate approximate inference in probabilistic graphical models using a novel non-normalized Knuth-Yao sampling method and inter-core register sharing. The architecture features a RISC-V host and a 2D mesh of 16 optimized RISC-V cores, achieving significant performance gains with 1277 MSample/s at 0.9V and 20 GSamples/s/W at 0.7V, which translates to up to 2x faster processing and 1.45x improved energy efficiency compared to existing Markov Random Field accelerators. By integrating a customized compiler for efficient spatial mapping and scheduling, AIA demonstrates the potential for enhanced decision-making capabilities at the edge in machine learning applications.
AIA achieves up to 2x faster approximate inference with 1.45x better energy efficiency, revolutionizing edge decision-making in probabilistic models.
Probabilistic graphical models (PMs) are popular to empower machine learning with the ability of reasoning and decision-making. To perform approximate inference in PMs, sampling-based Markov Chain Monte Carlo (MCMC) algorithms are commonly employed. Unfortunately, MCMC is compute-intensive and hard to run in parallel, resulting in inefficient execution on modern CPU/GPU platforms. This paper proposes \name{}, an Approximate Inference Accelerator designed to empower decision-making and reasoning at the edge. \name{} consists of a RISC-V host, and a 2D mesh of 16 customized RISC-V cores optimized to efficiently support PM inference, each featuring (i) a novel non-normalized Knuth-Yao sampler and interpolation unit; and (ii) core-to-core direct data access via the register file, which provides solutions for compute-intensive operations. To fully exploit the parallel potential of Markov Chain Monte Carlo (MCMC) algorithms, a customized compiler chain has been developed for effective spatial mapping and scheduling on the chip. \name{} can generate 1277 MSample/s at 0.9V and 20 GSamples/s/W at 0.7V which is up to 2$\times$ faster and 1.45x more energy efficient compared to the previous state-of-the-art Markov Random Field (MRF) accelerator. We further map Bayesian Networks benchmark onto \name{} to show the flexibility of our design.
