Search papers, labs, and topics across Lattice.
HintPilot leverages LLMs to synthesize compiler hints, guiding traditional compilers to navigate complex optimization spaces more effectively. It uses retrieval-augmented synthesis over compiler documentation combined with profiling-guided iterative refinement to ensure both semantic correctness and performance gains. Experiments on PolyBench and HumanEval-CPP show HintPilot achieves up to 6.88x geometric mean speedup over the -Ofast optimization level.
LLMs can supercharge traditional compilers, achieving up to 6.88x speedups by synthesizing precise compiler hints that unlock hidden optimization opportunities.
Code optimization remains a core objective in software development, yet modern compilers struggle to navigate the enormous optimization spaces. While recent research has looked into employing large language models (LLMs) to optimize source code directly, these techniques can introduce semantic errors and miss fine-grained compiler-level optimization opportunities. We present HintPilot, which bridges LLM-based reasoning with traditional compiler infrastructures via synthesizing compiler hints, annotations that steer compiler behavior. HintPilot employs retrieval-augmented synthesis over compiler documentation and applies profiling-guided iterative refinement to synthesize semantics-preserving and effective hints. Upon PolyBench and HumanEval-CPP benchmarks, HintPilot achieves up to 6.88x geometric mean speedup over -Ofast while preserving program correctness.