Search papers, labs, and topics across Lattice.
This paper evaluates the performance of tiled Cholesky decomposition by comparing four parallelization strategies using OpenMP and HPX asynchronous many-task (AMT) runtimes. The authors introduce Cholesky-Bench to benchmark these strategies on a dual-socket 128-core AMD Zen 2 node, revealing that HPX consistently outperforms OpenMP by 15%-30% at optimal tile sizes, with asynchronous tasks being up to 26% faster and exhibiting significantly lower task overhead. Additionally, the study highlights that collapsing fork-join variants can significantly reduce synchronization overhead, further enhancing performance across both runtimes.
Asynchronous tasks in HPX can deliver up to 26% faster performance than OpenMP in tiled Cholesky decomposition, challenging the dominance of traditional fork-join models.
Fork-join parallelism, popularized by OpenMP, remains the dominant model for shared-memory parallel programming, but its implicit synchronization barriers can penalize algorithms with inhomogeneous workloads. Asynchronous many-task (AMT) runtimes sidestep these barriers by expressing work as a dependency graph of fine-grained tasks. Yet, the actual performance benefit over a carefully written fork-join baseline is rarely quantified. In this work, we introduce Cholesky-Bench and use it to revisit the tiled Cholesky decomposition, a canonical irregular kernel, comparing four parallelization variants of the right-looking algorithm across two runtimes: the OpenMP implementations shipped with GCC and LLVM, and the HPX AMT runtime. The variants span classical fork-join, a collapsed fork-join that exposes additional inner-loop parallelism, synchronous tasking, and asynchronous tasking with explicit data dependencies. We benchmark all eight combinations on a dual-socket 128-core AMD Zen 2 node across multiple tile sizes and problem sizes. Our results show that across all variants, HPX outperforms OpenMP at the optimal tile size by 15%-30%. Specifically, asynchronous HPX tasks are up to 26% faster than their OpenMP counterparts, and exhibit roughly 3.8x smaller task overhead. Furthermore, the collapsed fork-join variants close most of the gap to synchronous tasking. Removing redundant synchronization barriers yields an additional improvement of 7% (OpenMP) to 14% (HPX). A GCC-versus-LLVM comparison further reveals compiler-specific differences in fork-join scheduling and task-creation overheads.
