Search papers, labs, and topics across Lattice.
This study evaluates three CUDA optimization strategies for enhancing forward and backward propagation in shallow neural networks, focusing on memory access efficiency. The optimizations include tiled shared memory with bank-conflict elimination, pre-transposed weight matrices for coalesced access, and a fused MatMul+ReLU kernel to minimize global-memory round-trips. The results indicate a significant performance improvement, with the optimized implementation achieving a 1.41x speedup on a large dataset compared to the baseline CUDA version, underscoring the importance of memory-access strategies in GPU-accelerated deep learning.
Achieving a 1.41x speedup in shallow neural network training demonstrates the transformative potential of memory-access optimizations in GPU implementations.
We present a comparative study of CUDA optimization strategies applied to forward and backward propagation in a shallow neural network. Three stacked optimizations are evaluated: (1) tiled shared memory with bank-conflict elimination via +1-column padding, (2) pre-transposed weight matrices for coalesced global memory access, and (3) a fused MatMul+ReLU kernel that eliminates intermediate global-memory round-trips. Experiments on an NVIDIA Tesla T4 (CUDA 13.0) across three dataset sizes show that the fully optimized implementation achieves a 1.41x speedup over the baseline CUDA version on the large dataset (25,600 samples), reducing execution time from 21.0s to 14.8s. Results are compared against a sequential CPU baseline and an OpenMP parallel implementation, demonstrating the effectiveness of memory-access optimization in GPU-accelerated deep learning primitives.
