Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a methodology for characterizing and correcting power and energy sensor data on AMD Instinct MI250X GPU and MI300A APU-based exascale systems, addressing inconsistencies in scope, update rate, and timing. The approach uses controlled square-wave workloads to quantify sensor characteristics like update intervals, delay, and aliasing across hundreds of GPUs/APUs, and reconstructs power from energy counters for faster response times. Applied to benchmarks like rocHPL, the method accurately attributes energy savings to runtime reductions versus power changes, demonstrating significant energy reductions with mixed precision.
Reliably disentangling short-lived power fluctuations on exascale GPUs is now possible, revealing that mixed precision can slash node energy consumption by up to 79%.
Modern exascale GPU- and APU-based systems provide multiple power and energy sensors, but differences in scope, update rate, timing, and filtering complicate the attribution of short-lived accelerator activity. This paper presents a methodology to characterize and correct these effects on Cray EX systems with AMD Instinct MI250X GPUs (Frontier) and MI300A APUs (Portage). Using controlled square-wave workloads, we quantify update intervals, delay, aliasing, and variability across up to 512 GPUs and 480 APUs with on-chip (rocm-smi/amd-smi) and off-chip Cray Power Management sensors. We reconstruct power from cumulative energy counters to achieve faster response times, validate it against on-chip, off-chip, and node-level sensors, and integrate the resulting streams into a Score-P/PAPI-based tool for time-aligned, phase-level attribution. Applied to rocHPL, rocHPL-MxP, and HPG-MxP, the method separates energy savings due to reduced runtime from changes in power. Mixed precision reduces node energy on Frontier by 79% for rocHPL-MxP and 31% for HPG-MxP, with similar trends on Portage. These results provide portable guidance for sensor validation and power-aware optimization on current and future exascale systems.