Search papers, labs, and topics across Lattice.
This paper introduces DEFT, an energy-aware scheduling framework that optimally combines task placement and Dynamic Voltage and Frequency Scaling (DVFS) for multi-GPU applications. By integrating slack awareness and throughput considerations, DEFT effectively addresses the interdependencies between task execution, inter-GPU communication, and energy consumption, which are often overlooked in existing systems. The results demonstrate that DEFT achieves an average energy reduction of 14.8% on NVIDIA L40S and 4.8% on L4, while maintaining performance within 1.5% of the fastest baseline.
Energy-efficient multi-GPU scheduling can be significantly enhanced by jointly optimizing task placement and DVFS, yielding up to 14.8% energy savings without sacrificing performance.
Energy efficiency has become a first-order concern in modern high-performance computing systems, as it directly determines achievable throughput under fixed power budgets. Although Dynamic Voltage and Frequency Scaling (DVFS) provides an effective mechanism for reducing GPU energy consumption, existing runtime systems decouple DVFS from task placement and inter-GPU communication, focus on single-GPU execution, or cannot adapt frequency to task granularity and runtime contention in multi-GPU environments. Consequently, current schedulers fail to capture the tight coupling between task placement, frequency selection, and inter-GPU data movement that fundamentally governs energy鈥損erformance trade-offs on multi-GPU systems. This paper presents DEFT, an energy-aware scheduling framework that jointly optimizes task-to-device assignment and per-GPU DVFS configuration for task-based multi-GPU applications. DEFT employs a cost-model鈥揹riven strategy that integrates slack awareness, throughput awareness, and explicit modeling of task execution cost, inter-GPU data movement, and DVFS transition overheads, enabling coordinated placement and frequency decisions at task granularity under dynamic runtime conditions. We prototype DEFT within the CUDASTF runtime and demonstrate its effectiveness across five optimization objectives. The evaluation shows that DEFT reduces energy consumption by 14.8% and 4.8% on average on NVIDIA L40S and L4, and reduces EDP by 9.9% and 3.7%, respectively, while maintaining performance within 1.5% of the fastest baseline.
