Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces CompPow, a component-aware power management approach for GPUs, motivated by the increasing power demands of ML workloads. They show that by dynamically adjusting power allocation to individual GPU components based on workload demands, they achieve both improved energy efficiency (10%) and performance (5%) across various ML operations. The authors advocate for software-hardware co-design to further optimize energy efficiency in modern GPUs.
Fine-grained power management at the GPU component level can simultaneously boost performance and energy efficiency for ML workloads, challenging the assumption that GPU power is a monolithic concern.
The ever increasing demand for ML-driven intelligence in a wide spectrum of domains has led to ubiquity of GPUs. At the same time, GPUs are notorious for their power consumption needs and often dominate power allocation in a typical ML datacenter. While datacenter-level power optimizations which focus on collection of GPUs are promising, in this work, we take a different tack -- namely, we take a closer look at power consumption inside a GPU. Specifically, as modern GPUs are comprised of integrated components, we make a case for component-awareness, termed CompPow in this work, for improved power management in modern GPUs. We demonstrate for a variety of ML operations and execution patterns, CompPow has the potential to deliver higher energy efficiency (10%) and even improved performance (5%). We conclude with recommendations on how component-aware software-hardware co-design can extract additional energy efficiency from modern GPUs.