Search papers, labs, and topics across Lattice.
This paper evaluates the effectiveness of zero-overhead NVML telemetry for monitoring GPU workloads in the context of adversarial evasion strategies. By testing 20 evasion strategy families across 9 GPU models, the authors demonstrate that their classifier can achieve an impressive 98.2% accuracy in identifying training workloads, even maintaining 43-87% accuracy against sophisticated adversarial disguises. These findings highlight the potential of hardware-enabled monitoring to withstand attempts to circumvent AI compute governance mechanisms.
Achieving 98.2% accuracy in identifying hidden ML training workloads, even against sophisticated evasion tactics, reveals a breakthrough in adversarial robustness for GPU monitoring.
Hardware-enabled monitoring of GPU workloads underpins many proposals for AI compute governance, but if developers can defeat monitoring mechanisms, such schemes are unworkable. We evaluate the adversarial robustness of GPU workload classification using only zero-overhead, privacy-preserving NVML telemetry: content-agnostic signals that observe physical effects of computation without accessing model weights, training data, or hyperparameters. Across 5 rounds of monitor-evader iteration, we evaluate 20 evasion strategy families on 9 GPU models spanning 4 architecture generations. We develop a classifier that achieves 98.2% binary accuracy at identifying training workloads across the whole corpus, and 43-87% accuracy against the most challenging unexpected workloads even when they are adversarially disguised.