Search papers, labs, and topics across Lattice.
This paper introduces EcoSched, an online scheduler designed to optimize GPU allocation and application co-scheduling in high-performance computing (HPC) environments. By leveraging lightweight runtime profiling and a score-based policy, EcoSched effectively balances energy efficiency and resource utilization, achieving significant improvements in energy savings and workload execution time. The results demonstrate that EcoSched can deliver up to 14.8% energy savings and 30.1% makespan improvement compared to baseline schedulers, highlighting the importance of joint GPU count selection and co-scheduling for efficient multi-GPU operations.
EcoSched reveals that optimizing GPU count and co-scheduling can lead to up to 14.8% energy savings in high-performance computing systems.
Modern multi GPU HPC systems expose substantial computational capacity, yet inefficient GPU allocation often leads to wasted energy and underutilization. In practice, GPU applications exhibit heterogeneous and nonlinear scaling, making it inefficient to always use all available GPUs. We present EcoSched, an online scheduler that jointly optimizes GPU count selection and application coscheduling to improve workload level efficiency on multi GPU systems. EcoSched uses lightweight runtime profiling to estimate relative performance across GPU counts, applies a score based policy to balance energy efficiency and idle resources, and incorporates NUMA aware placement to mitigate interference. We implement EcoSched on heterogeneous CPU GPU platforms and evaluate it with diverse workloads on H100, A100, and V100 systems. EcoSched achieves up to 14.8% energy savings, 30.1% makespan improvement, and 40.4% EDP reduction over baseline schedulers, with modest performance overhead. These results show that jointly selecting GPU counts and coscheduling actions is essential for efficient multi GPU workload execution.
