Search papers, labs, and topics across Lattice.
This paper reviews recent advances in sparse direct solvers, focusing on techniques to improve their efficiency for large-scale, ill-conditioned, and indefinite algebraic equations arising in scientific computing and machine learning. It examines methods for reducing communication and latency costs through task and data parallelism, as well as techniques for reducing computational complexity using low-rank approximations and hierarchical matrix algebra. The review highlights parallelization challenges and best practices for achieving high performance on modern heterogeneous parallel architectures.
Sparse direct solvers are getting a speed boost thanks to communication-reducing parallelization strategies and low-rank compression techniques.
Efficient solutions of large-scale, ill-conditioned and indefinite algebraic equations are ubiquitously needed in numerous computational fields, including multiphysics simulations, machine learning, and data science. Because of their robustness and accuracy, direct solvers are crucial components in building a scalable solver toolchain. In this article, we will review recent advances of sparse direct solvers along two axes: 1) reducing communication and latency costs in both task- and data-parallel settings, and 2) reducing computational complexity via low-rank and other compression techniques such as hierarchical matrix algebra. In addition to algorithmic principles, we also illustrate the key parallelization challenges and best practices to deliver high speed and reliability on modern heterogeneous parallel machines.
Tsinghua AI