Search papers, labs, and topics across Lattice.
This paper introduces a novel execution mode called stale synchronous parallel for solving parallel sparse triangular linear systems, leveraging a directed-acyclic-graph scheduler named ElasticDivide. By overlapping synchronization and computation, the proposed method achieves significant speed-ups, with improvements ranging from 7% to 30% on ARM architectures and 19% to 60% on x86 architectures compared to existing synchronous schedulers. These results highlight the potential for enhanced performance in parallel computing environments, particularly in high-core-count systems.
Stale synchronous parallel execution can accelerate sparse triangular solves by up to 60%, transforming performance expectations in high-core computing.
We introduce stale synchronous parallel as a mode of execution in parallel sparse triangular linear system solve and present a general directed-acyclic-graph scheduler capable of producing such schedules. Stale-synchronous-parallel schedules allow the overlap of synchronisation and compute which results in a geometric-mean speed-up of $7$-$30\%$ of our scheduler, ElasticDivide, over state-of-the-art synchronous scheduler GrowLocal on an ARM machine using 48 cores. On an x86 machine using 48 cores, we report geometric-mean speed-ups of $19$-$60\%$ over SpMP.
