Search papers, labs, and topics across Lattice.
This paper examines the impact of prompt optimization (PO) on LLM evaluation, revealing that static prompt templates can lead to misleading model rankings. By optimizing prompts for each model before evaluation, the authors demonstrate significant shifts in relative performance across both academic and industry benchmarks. This underscores the necessity of incorporating PO into LLM evaluation pipelines to ensure accurate model selection.
Model rankings on standard benchmarks can flip entirely when you optimize prompts for each LLM, so your "best" model might actually be the worst.
Current Large Language Model (LLM) evaluation frameworks utilize the same static prompt template across all models under evaluation. This differs from the common industry practice of using prompt optimization (PO) techniques to optimize the prompt for each model to maximize application performance. In this paper, we investigate the effect of PO towards LLM evaluations. Our results on public academic and internal industry benchmarks show that PO greatly affects the final ranking of models. This highlights the importance of practitioners performing PO per model when conducting evaluations to choose the best model for a given task.
Stanford HAI