Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper addresses the critical bottlenecks posed by concurrent queues in high-performance computing (HPC) systems, particularly as they scale beyond 10 million processor cores. The authors introduce three innovative GPU concurrent queues—G-WFQ-YMC, G-LFQ, and G-WFQ—each designed to optimize task distribution and resource utilization while maintaining linearizability and minimizing locking overhead. Key results demonstrate that these queues significantly enhance throughput and efficiency in GPU environments, paving the way for improved performance in supercomputing applications.
GPU concurrent queues can achieve unprecedented efficiency, with designs that maximize throughput while minimizing locking overhead.
Concurrent queues can significantly impact supercomputing performance by being critical bottlenecks for task distribution, load balancing, and resource utilization. As HPC systems move beyond 10-million processor cores, the ability to rapidly move items between producer and consumer threads without excessive locking is essential for efficient queues, preventing idle cores, maximizing utilization, and achieving high parallel speedup. While concurrent queues are well studied on CPUs, they remain largely unexplored on modern GPUs, where SIMT execution, massive parallelism, and atomic contention reshape the design space. We present three linearizable GPU concurrent queues spanning from lock-free to wait-free guarantees: (1) G-WFQ-YMC, an adaptation of Yang and Mellor-Crummey's wait-free queue using preallocated segments; (2) G-LFQ, a bounded lock-free queue that uses wave-batched fast paths to maximize throughput; and (3) G-WFQ, a bounded wait-free queue that packs shared state into 64-bit compare-and-swap operations while preserving linearizability and bounded memory.