Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a multithreaded fine-grained asynchronous BSP (FA-BSP) approach for integer sorting, leveraging the Lightweight Communication Interface (LCI) and OpenMP to enhance computation-communication overlap on multicore architectures. The approach replaces synchronous MPI collectives with OpenMP multithreading and LCI's active messages, enabling efficient fine-grained communication. Evaluation using the NAS Parallel Benchmark Integer Sort (IS) shows that the multithreaded FA-BSP implementation significantly outperforms traditional bulk-synchronous MPI implementations, particularly with irregular Gaussian distributions.
Multithreading asynchronous BSP with LCI and OpenMP blows away traditional MPI for irregular integer sorts, finally unlocking the potential of multicore architectures.
The bulk synchronous parallel (BSP) model struggles with irregular workloads due to rigid global communication. While fine-grained asynchronous BSP (FA-BSP) improves overlap, existing implementations typically rely on a limiting one-process-per-core model. This paper proposes a multithreaded FA-BSP approach combining Lightweight Communication Interface (LCI) and OpenMP to fully exploit multicore architectures. We evaluate this design using the NAS Parallel Benchmark Integer Sort (IS), retaining the original irregular Gaussian distribution to rigorously test load balancing. By replacing synchronous MPI collectives with OpenMP multithreading and LCI's fine-grained, zero-copy active messages, we enable efficient computation-communication overlap. Our evaluation demonstrates that multithreaded FA-BSP significantly outperforms traditional bulk-synchronous MPI implementations, offering a scalable solution for irregular scientific applications.