Search papers, labs, and topics across Lattice.
This paper introduces a merged multiply-add (MMA) architecture that enhances the energy efficiency of convolutional layers in the U-Net architecture for image segmentation, implemented on FPGA. By fusing multiplication and addition operations into a single pipeline, the MMA architecture reduces the latency typically associated with cascaded digit-serial arithmetic, resulting in significantly improved throughput. The proposed design achieves up to 15.14 GOPS/W energy efficiency, outperforming CPU-based inference by an order of magnitude and demonstrating a 9x reduction in energy consumption compared to traditional MSDF-based FPGA implementations.
Merging multiplication and addition in FPGA architectures can boost energy efficiency for image segmentation tasks by up to 9x compared to existing methods.
This paper presents an energy-efficient hardware acceleration of the convolutional layers in the U-Net architecture for image segmentation, implemented on FPGA. While digit-serial arithmetic, particularly most-significant-digit-first (MSDF) techniques, offers a compact hardware footprint, it suffers from initial latency before producing the first output digit. This delay accumulates in cascaded operations like multiplication followed by addition, where each unit introduces its own startup overhead. To overcome this, we propose a merged multiply-add (MMA) architecture that fuses these operations into a unified pipeline. Instead of incurring separate delays, the MMA introduces a single streamlined latency per iteration, shorter than the combined latency of conventional cascaded units, resulting in enhanced throughput and efficiency. The MMA units are designed to process spatial input depths in parallel, achieving significantly higher performance than both standalone MSDF-based and conventional designs. We evaluate the proposed design using U-Net as a target application. Despite operating at a lower frequency than a CPU, the FPGA-based accelerator achieves up to an order of magnitude higher energy efficiency, delivering up to $15.14$ GOPS/W compared to $1.93$ GOPS/W for CPU-based inference. The design also shows approximately $9\times$ reduction in energy consumption compared to MSDF-based FPGA implementations. These results highlight the efficacy of the merged arithmetic approach for resource-constrained, latency-sensitive edge applications in medical imaging and computer vision.
