Search papers, labs, and topics across Lattice.
The paper introduces Record-Remix-Replay (R^3), a hierarchical GPU kernel optimization framework that leverages LLMs for evolutionary search combined with Bayesian optimization and record-replay compilation. R^3 efficiently explores a multi-dimensional optimization space, spanning source code, compiler passes, and runtime configurations. Results show R^3 outperforms traditional optimization methods on scientific applications, achieving near 10x speedup compared to modern evolutionary search.
Optimizing GPU kernels doesn't have to be a manual slog: R^3's LLM-guided evolutionary search automates the process across source code, compiler passes, and runtime configs.
As high-performance computing and AI workloads become increasingly dependent on GPUs, maintaining high performance across rapidly evolving hardware generations has become a major challenge. Developers often spend months tuning scientific applications to fully exploit new architectures, navigating a complex optimization space that spans algorithm design, source implementation, compiler flags and pass sequences, and kernel launch parameters. Existing approaches can effectively search parts of this space in isolation, such as launch configurations or compiler settings, but optimizing across the full space still requires substantial human expertise and iterative manual effort. In this paper, we present Record-Remix-Replay (R^3), a hierarchical optimization framework that combines LLM-driven evolutionary search, Bayesian optimization, and record-replay compilation techniques to efficiently explore GPU kernel optimizations from source-level implementation choices down to compiler pass ordering and runtime configuration. By making candidate evaluation fast and scalable, our approach enables practical end-to-end search over optimization dimensions that are typically treated separately. We show that Record-Remix-Replay can optimize full scientific applications better than traditional approaches over kernel parameters and compiler flags, while also being nearly an order of magnitude faster than modern evolutionary search approaches.
