Search papers, labs, and topics across Lattice.
This study investigates the performance gap between peak arithmetic throughput of modern matrix engines and their actual utilization in scientific applications, specifically focusing on the stiffness operator in SPECFEM3D on Arm LX2 CPUs. The authors find that while the matrix engine offers a theoretical $4\times$ speedup, practical gains are limited to $1.1\times$ due to inefficiencies in pointwise computation, indirect field movement, and synchronization. By implementing explicit SIMD and optimizing field layouts and coefficient streaming, they achieve a maximum speedup of $1.6\times$, highlighting the necessity of co-designing the entire operator path for effective performance gains.
Achieving a mere $1.6\times$ speedup from a theoretical $4\times$ peak illustrates the critical need for holistic optimization in matrix computations.
Modern processors increasingly provide matrix engines whose peak arithmetic throughput greatly exceeds conventional SIMD, but scientific applications rarely realize this advantage end to end. We examine this gap in SPECFEM3D's dominant stiffness operator on the Arm LX2 CPUs that power the flagship Lineshine supercomputer. Against a matched, high-performance SVE baseline on the same cores, SME's $4\times$ single-precision peak advantage falls to $2.2\times$ for isolated tensor contractions and $1.1\times$ for the complete operator. Our factorized diagnostic attributes the loss to pointwise computation, indirect field movement and synchronization, and irregular coefficient delivery. Explicit SIMD mitigates pointwise work, raising the full-operator speedup to $1.3\times$. Field-layout changes mitigate indirect movement and synchronization, while vector-blocked coefficient streaming reduces irregular-access costs; together they raise speedup to $1.6\times$ at high order. A contraction-free control bounds further contraction-only gains at $1.11$--$1.32\times$. Realizing matrix-engine performance therefore requires co-designing the entire operator path, not merely replacing its contraction kernel.
Tsinghua AI