Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces soft-prompt tuning as a method to enhance the evaluation of large language models (LLMs) by optimizing a minimal number of soft-prompt vectors, which allows models to better adhere to benchmark formatting requirements without extensive post-training. The approach addresses the issue of misrepresented knowledge in benchmark scores by ensuring that the inherent knowledge of base models is accurately reflected, thus enabling fair comparisons across models trained with different recipes. Results indicate that soft-prompt tuning not only saturates format-following efficiency within 80 steps but also significantly surpasses traditional prompting methods, providing a reliable proxy for assessing downstream model quality.
Soft-prompt tuning can reveal hidden knowledge in base models, outperforming traditional prompting methods and offering a low-cost proxy for downstream performance evaluation.
Benchmark scores often misrepresent a large language model's (LLM's) knowledge, because they rely, e.g., on the model's ability to follow specific formatting requirements. This especially penalizes base models that may know the correct answers but lack the ability -- typically introduced in post-training -- to structure them as instructed. To overcome this, we propose soft-prompt tuning, an efficient, fair, and architecture-agnostic model evaluation. By optimizing only 10 soft-prompt vectors (roughly 0.0006% parameters for a 7B model) over a short tuning period, we adapt models to specific benchmark formats, closing gaps in format-following and ensuring that underlying knowledge is accurately reflected in benchmark scores. This allows one to fairly compare different base models -- trained with various pre-training recipes -- on benchmarks without the need for full post-training. We evaluated soft-prompt tuning across 7 models and 7 datasets. The results show that (a) soft-prompt tuning saturates format-following within 80 steps (~640 samples) making it highly efficient, (b) soft-prompt tuning significantly outperforms zero- and few-shot prompting, surfacing base model knowledge that standard prompting misses, that (c) even post-trained models can benefit from soft-prompts to maximize format compliance, and that (d) soft-prompted base model performance predicts post-trained model rankings more reliably than zero- and few-shot baselines, offering a low-cost proxy for downstream model quality. Our contributions include (1) metrics which disentangle format-following and knowledge accuracy, (2) a fairer benchmarking protocol of LLM knowledge, and (3) a cost- and memory-effective recipe to identify optimal pre-training strategies early in LLM development.