Search papers, labs, and topics across Lattice.
The Linear Algebra Aware Benchmarks (LAAB) framework is introduced to systematically evaluate and report the performance of mathematical library installations on high-performance computing (HPC) systems. This framework is crucial for enhancing application efficiency and guiding resource allocation by ensuring traceability, compatibility, reliability, and accessibility in performance reporting. Key results demonstrate that LAAB effectively addresses the challenges of measurement variability and provides a structured approach to linking library performance with scientific applications.
LAAB transforms performance reporting for mathematical libraries, ensuring that every benchmark is traceable and relevant to real-world scientific applications.
We present the Linear Algebra Aware Benchmarks (LAAB) framework for systematically assessing and reporting the performance of mathematical library installations on HPC systems. Mathematical libraries provide interfaces for operations that form the computational building blocks of scientific applications. Reporting their performance is important for assessing application efficiency, estimating compute-time requirements, and preparing resource-allocation requests. In this paper, we define four objectives for performance reporting: 1) traceability, linking each report to the exact library installation and execution settings; 2) compatibility, relating library-operation performance to higher-level scientific applications that use them; 3) reliability, supporting interpretation in the presence of measurement variability; and 4) accessibility, ensuring that reports, benchmark definitions, and relevant metadata are available for inspection and reproduction. We then present the design of LAAB and show how it addresses the challenges associated with these objectives.
