Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study systematically evaluates various training strategies aimed at reducing prompt sensitivity in large language models. By reproducing and comparing existing methods, including robustness fine-tuning and data construction techniques, the authors reveal that while some strategies improve performance, a significant prompt gap of 40-57% persists. Notably, the simplest approach of training on one template per batch often outperforms more complex robustness-enhancing methods like CoIN and PPCL, highlighting fundamental limitations in current robustness objectives.
Despite advanced training strategies, a staggering 40-57% performance gap remains in prompt sensitivity for large language models.
Despite their strong performance, large language models remain highly sensitive to prompt formulation. Prior work addresses this through refined data construction or through dedicated robustness objectives. We reproduce and compare these strategies under controlled conditions, and measure how effective they are in addressing models' prompt sensitivity. We find the current robustness fine-tuning methods improve over standard fine-tuning and in-context learning, but the best-to-worst prompt gap remains as high as 40-57% of performance. Moreover, the recent robustness-enhancing methods we test - CoIN for contrastive alignment and PPCL for consistency regularization - often fail to outperform the simplest data construction strategy: training on one template per batch. Our diagnostics explain these results. The auxiliary objectives move the quantity they penalize, but do not generalize beyond it. Additionally, data construction strategies differ due to the conflicting signs of per-template gradients on 57-64% of parameters. Thus, batches that mix formulations force the optimizer to reconcile competing updates instead of finding a shared, prompt-agnostic one.