Search papers, labs, and topics across Lattice.
This paper explores the capabilities of AI-oriented accelerators, specifically the Ascend 910 NPU series, in handling scientific workloads that require numerical robustness and efficient memory access. Through five application studies, the authors identify key bottlenecks in precision and execution, and propose tailored workload mappings that leverage heterogeneous execution and mixed-precision formulations. The findings demonstrate that with coordinated strategies for numerical formulation, execution placement, and data movement, AI-native NPUs can effectively support scientific computing tasks while maintaining performance and scalability.
AI-native NPUs can achieve competitive performance in scientific computing by addressing precision and memory bottlenecks through tailored workload mappings.
The rapid rise of AI-oriented accelerators has reshaped compute systems around low-precision tensor engines, raising a practical question for the HPC community: under what conditions can such hardware support scientific workloads that demand numerical robustness, irregular memory access, and scalability? Using the Ascend 910 NPU series as a representative tensor-centric platform, we characterize precision, execution, and memory-hierarchy bottlenecks that hinder the direct deployment of scientific codes. We then develop and evaluate workload-specific mappings across five application studies -- HPL-MxP, LRSVD, SGEMM-cube, PQSim, and SMC-X -- combining heterogeneous execution, mixed-precision numerical formulations, precision emulation, hierarchical memory orchestration, and communication--computation overlap. These studies show that AI-native NPUs can achieve numerical robustness, competitive performance, and satisfactory scalability when numerical formulation, execution placement, and data movement are addressed in a coordinated manner. Our results provide a state-of-the-practice case study of how scientific workloads can be adapted to tensor-centric architectures, while distinguishing transferable optimization principles from Ascend-specific implementation details.
