Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a novel performance analysis tool specifically designed for virtualized environments utilizing GPU resources, addressing the limitations of existing performance tools that do not support virtual GPUs (vGPUs). By employing software tracing techniques, the tool collects detailed runtime data and generates performance metrics, facilitating a deeper understanding of GPU operations within virtual machines. Key findings demonstrate that the tool effectively identifies performance bottlenecks in vGPU-enabled systems, enhancing the debugging and optimization process for GPU-accelerated applications.
A new performance analysis tool reveals critical bottlenecks in GPU-accelerated applications running on virtual machines, where traditional tools fall short.
The graphics processing unit (GPU) plays a crucial role in boosting application performance and enhancing computational tasks. Thanks to its parallel architecture and energy efficiency, the GPU has become essential in many computing scenarios. On the other hand, the advent of GPU virtualization has been a significant breakthrough, as it provides scalable and adaptable GPU resources for virtual machines. However, this technology faces challenges in debugging and analyzing the performance of GPU-accelerated applications. Most current performance tools do not support virtual GPUs (vGPUs), highlighting the need for more advanced tools. Thus, this article introduces a novel performance analysis tool that is designed for systems using vGPUs. Our tool is compatible with the Intel GVT-g virtualization solution, although its underlying principles can apply to many vGPU-based systems. Our tool uses software tracing techniques to gather detailed runtime data and generate relevant performance metrics. It also offers many synchronized graphical views, which gives practitioners deep insights into GVT-g operations and helps them identify potential performance bottlenecks in vGPU-enabled virtual machines.