Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper explores using LLMs to automatically derive efficient thread mapping functions for GPUs operating on non-box-shaped domains, a task traditionally requiring significant manual effort. They demonstrate that open-weight LLMs can infer O(1) and O(log N) mapping equations for complex 2D/3D domains and fractals, surpassing traditional symbolic regression methods. While LLM inference has a high upfront energy cost, the resulting kernels yield substantial energy and time savings (up to 4833x speedup and 2890x energy reduction) during GPU workloads, although limitations exist for highly recursive 3D fractals.
Forget hand-tuning GPU kernels: LLMs can now automatically generate code that slashes energy consumption by 2890x and boosts speed by 4833x for complex, non-rectangular domains.
Mapping parallel threads onto non-box-shaped domains is a known challenge in GPU computing that, if done efficiently, can prevent severe performance penalties from allocating unnecessary computational resources. Currently, achieving this optimal efficiency requires significant analytical human time and effort to manually derive bespoke mapping functions for each specific geometry. This work introduces a novel approach leveraging the symbolic reasoning capabilities of Large Language Models (LLMs) to automate this mathematical derivation process entirely through in-context learning. Focusing on state-of-the-art open-weights models, we conducted a rigorous comparative analysis across spatial domains of increasing complexity. Our results demonstrate that modern local LLMs successfully infer exact O(1) and O(log N) mapping equations for complex 2D/3D dense domains and 2D fractals, vastly outperforming traditional symbolic regression methods which systematically failed at this discrete task. Crucially, we profile the energetic viability of this approach on high-performance infrastructure, drawing a clear distinction between the code-generation and execution phases. While the one-time inference of the equation incurs a high energy penalty -- particularly for reasoning-focused models like DeepSeek-R1 -- this is a single upfront investment. Once integrated, the generated analytical kernels eliminate block waste entirely, yielding massive repeated energy and time savings (e.g., up to 4833x speedup and 2890x energy reduction) during actual GPU workloads. Finally, we identify a current "reasoning ceiling" when these models face highly recursive 3D fractals tested in this work (e.g., the Menger Sponge). This limitation establishes a clear benchmark for the maturity of open-weight architectures, charting a viable and sovereign path toward fully automated, energy-efficient GPU resource optimization.