Search papers, labs, and topics across Lattice.
This paper introduces a harness-centered system for optimizing GPU kernel generation using large language models (LLMs) in the MLSys 2026 FlashInfer AI Kernel Generation Contest. By separating the evaluation harness from a profile-backed optimization controller, the system ensures reliable code generation through enforced compilation, correctness, and timing, while leveraging human-authored skills and LLMs like Codex and Claude Code for candidate generation. The results show that the optimized kernels achieved significant mean-latency speedups over baseline artifacts, with the Agent-Assisted kernels outperforming those generated solely by LLMs, underscoring the importance of expert input in AI-driven optimization.
Expert-guided LLMs can achieve up to 29.68x speedups in GPU kernel performance, highlighting the critical role of human knowledge in AI-driven optimization.
Large language models (LLMs) can assist GPU kernel generation, but their practical effectiveness depends on whether generated code can be reliably constrained, validated, profiled, and selected. This paper presents a harness-centered system for LLM-driven GPU kernel optimization in the MLSys 2026 FlashInfer AI Kernel Generation Contest on NVIDIA Blackwell B200 GPUs. The system separates an evaluation harness from a profile-backed optimization controller: the harness enforces compilation, correctness, official-aligned timing, and artifact archival, while the controller turns profiler and workload evidence into bounded candidate-generation decisions. Human-authored skills capture operator constraints, references, profiling procedures, and promotion rules, while Codex and Claude Code agents generate candidate kernels inside those constraints. Across five operator definitions, the retained official-aligned artifacts achieved mean-latency speedups over supplied FlashInfer baselines of 1.62x, 18.05x, 29.68x, 1.12x, and 13.70x. The Agent-Assisted kernels outperform the Full-Agent artifacts across the evaluated definitions, indicating that expert-provided optimization directions, high-quality references, and workload context remain critical for reliable AI-driven kernel optimization.
