Search papers, labs, and topics across Lattice.
This study evaluates the efficiency of CPU-GPU coscheduling on the NVIDIA GH200 Superchip versus the discrete H100 PCIe platform, focusing on workload partitioning and memory architecture. By using sparse conjugate gradient (CG) as a case study, the authors analyze various work divisions across three memory-management paradigms: explicit copy, managed memory, and mapped memory. The findings indicate that the GH200 platform significantly enhances the competitiveness of hybrid CPU-GPU work divisions and demonstrates the practicality of managed memory for various matrices, thereby improving both performance and programmability for coscheduled workloads.
The GH200 Superchip outperforms the H100 PCIe by making hybrid CPU-GPU work divisions competitive and simplifying memory management for complex workloads.
CPU-GPU coscheduling enables simultaneous execution of an application across both processing units, but its efficiency depends on workload partitioning and memory architecture. This preliminary study evaluates coscheduling on the NVIDIA GH200 Superchip compared to a discrete H100 PCIe platform. Using sparse conjugate gradient (CG) as a case study, we assess various work divisions across three memory-management paradigms: explicit copy, managed memory, and mapped memory. Our evaluation highlights the run time and programmability tradeoffs of reducing manual CPU-GPU data movement. The results show that compared with the H100 PCIe platform, GH200 makes several hybrid CPU-GPU work divisions competitive and makes managed memory practical for several matrices. These results suggest that integrated CPU-GPU platforms such as GH200 can improve both performance and programmability for coscheduled workloads.
