Search papers, labs, and topics across Lattice.
The authors created GMSBench, a standardized benchmark suite comprising 149 self-contained CUDA test cases that systematically span spatial, temporal, and concurrency memory safety violations across GPU memory hierarchies. Rigorous benchmarking is urgently needed as silent GPU memory corruption directly threatens distributed ML training stability and custom kernel security. Using GMSBench to evaluate NVIDIA's Compute Sanitizer across multiple hardware generations exposed significant detection gaps in current industry-standard error detection tooling.
Industry-standard GPU memory sanitizers harbor major blind spots across core memory spaces, finally quantifiable through 149 targeted CUDA stress tests.
As GPUs become increasingly integral to high-performance computing and machine learning, ensuring memory safety in GPU programs has become crucial for reliable and secure execution. However, evaluating GPU memory safety techniques remains challenging due to the lack of comprehensive and standardized benchmarks. In this paper, we present GMSBench, a GPU memory safety benchmark designed to evaluate a broad range of memory safety violations across different GPU memory spaces and execution scenarios. GMSBench comprises 149 self-contained CUDA tests spanning spatial, temporal, and concurrency errors. The suite provides a standardized foundation for the evaluation and comparative analysis of GPU memory safety mechanisms and helps expose gaps in their detection coverage. We demonstrate the utility of GMSBench by evaluating Compute Sanitizer, a widely used GPU memory error detection tool across multiple GPU architectures.
Microsoft Research
NVIDIA