Search papers, labs, and topics across Lattice.
This paper introduces SECDA-DSE, a framework that integrates Large Language Models (LLMs) into the SECDA ecosystem to automate the design space exploration (DSE) of FPGA-based accelerators. By leveraging retrieval-augmented generation and chain-of-thought prompting, SECDA-DSE significantly reduces the time and domain knowledge required for efficient accelerator configuration, successfully generating and executing designs for tasks like vector multiplication and 2D convolution on FPGA hardware. The findings demonstrate that LLM-guided exploration can effectively balance compute parallelism and data movement, showcasing its adaptability across various AI workloads.
LLM-guided exploration can drastically cut down the time and expertise needed for efficient FPGA accelerator design, generating viable architectures that perform well on diverse AI tasks.
Designing FPGA-based accelerators for modern artificial intelligence workloads requires exploring a large and complex hardware design space that involves architectural parameters, data flow strategies, and memory hierarchies, making the process very time consuming. While existing methodologies such as SECDA enable rapid hardware-software co-design through SystemC simulation and FPGA execution, identifying efficient accelerator configurations remains a largely manual process requiring extensive domain knowledge. SECDA-DSE is a framework that integrates Large Language Models (LLMs) into the SECDA ecosystem to guide design space exploration (DSE) of FPGA-based accelerators. It combines a structured DSE Explorer for generating candidate architectures with an LLM Stack that performs reasoning-guided exploration using retrieval-augmented generation and chain-of-thought prompting, coupled with a feedback loop for iterative and reinforced refinement. Building on our previous work introducing SECDA-DSE, this paper extends its evaluation by generating three accelerator designs, including element-wise vector multiplication, 2D convolution, and matrix transpose, and performing end-to-end execution on FPGA hardware. The results show that SECDA-DSE can generate SECDA-compliant accelerator designs that are successfully synthesized and executed on FPGA hardware. Furthermore, the generated designs capture kernel-specific trade-offs between compute parallelism and data movement, highlighting the potential of LLM-guided exploration to adapt architectural configurations across diverse workloads while reducing exploration time and the need for extensive human expertise.
