Search papers, labs, and topics across Lattice.
This paper introduces AIA, a customized multi-core RISC-V System-on-Chip (SoC) designed to optimize sampling-based Markov Chain Monte Carlo (MCMC) techniques for probabilistic models in edge devices. By leveraging a 2D mesh of 16 specialized RISC-V cores, each equipped with custom instructions for efficient sampling and function interpolation, AIA significantly reduces the computational costs associated with MCMC methods. The results demonstrate that AIA enhances the parallelization of inference tasks, enabling robust decision-making capabilities in safety-critical applications while minimizing data movement overhead.
AIA achieves unprecedented efficiency in MCMC sampling, enabling edge devices to perform complex probabilistic reasoning with minimal computational overhead.
Probabilistic models (PMs) are essential in advancing machine learning capabilities, particularly in safety-critical applications involving reasoning and decision-making. Among the methods employed for inference in these models, sampling-based Markov Chain Monte Carlo (MCMC) techniques are widely used. However, MCMC methods come with significant computational costs and are inherently challenging to parallelize, resulting in inefficient execution on conventional CPU/GPU platforms. To overcome these challenges, this paper presents AIA, a multi-core RISC-V System-on-Chip (SoC) design fabricated using Intel's 16 nm process technology. Our Approximate Inference Accelerator (AIA) is specifically designed to empower edge devices with robust decision-making and reasoning abilities. The AIA architecture incorporates a RISC-V host processor to manage chip-to-chip data communication and a 2D mesh of 16 custom versatile RISC-V cores optimized for high-efficiency approximate inference. Each core features (i) custom instructions and datapath blocks for non-normalized Knuth-Yao (KY) sampling, as well as for the interpolation of non-linear functions (e.g., logarithmic, exponential), and (ii) direct data access to the register file of each neighboring core, to reduce the data movement costs of frequent data exchanges between nearby cores. To further capitalize on the parallelism potential in MCMC algorithms, we developed a specialized compile chain that enables efficient spatial mapping and scheduling across the cores.
