Search papers, labs, and topics across Lattice.
This paper introduces a lightweight architectural enhancement for FPGAs that establishes a direct connection between block RAMs (BRAMs) and digital signal processing units (DSPs), significantly improving data transfer efficiency for deep learning workloads. By avoiding the global routing network, this approach reduces wirelength and critical-path delays while maintaining compatibility with existing FPGA architectures and CAD tools. The results demonstrate up to a 25% increase in maximum frequency (Fmax) and a 49% reduction in wirelength for common deep learning layer designs, showcasing the method's effectiveness without compromising performance on non-deep learning benchmarks.
Direct BRAM-DSP connections can boost FPGA performance by 25% without the need for extensive architectural overhauls.
Efficient data movement between memory and compute units is a key performance bottleneck in modern FPGA designs, particularly for deep learning (DL) workloads. In typical FPGA architectures, data transfers between block RAMs (BRAMs) and digital signal processing units (DSPs) must traverse the global routing network, leading to increased wirelength, routing congestion, and critical-path delays. Prior work has explored in- and near-BRAM compute architectures to mitigate these issues, but such solutions often require fundamental changes to FPGA architecture and CAD tools, limiting their commercial viability. This paper proposes a lightweight architectural enhancement that introduces a dedicated direct connection between BRAM and DSP blocks, enabling BRAM data to be consumed by DSPs without passing through the global interconnect. We also enhance the placement algorithm to recognize these BRAM-DSP macro blocks. The proposed architectural change incurs negligible area and delay overhead and does not affect non-DL benchmarks, while the proposed CAD remains compatible with the baseline architecture, where it yields negligible change in quality-of-results (QoR). On an Agilex-10-like FPGA, the proposed architecture and CAD updates deliver up to +25% Fmax and -49% wirelength on common DL layer designs.
