Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper identifies prompt distributional overfitting in LLM prompt optimization as a failure mode stemming from representational inefficiency, characterized by coupled growth in capacity cost and scope narrowness. To mitigate this, they introduce TextReg, a regularization framework employing regularized textual gradients via Dual-Evidence Gradient Purification, Semantic Edit Regularization, and Regularization-Guided Prompt Update. TextReg significantly enhances out-of-distribution generalization on reasoning benchmarks, achieving substantial accuracy improvements over existing methods.
Prompt optimization methods that iteratively rewrite prompts with LLM feedback often overfit to training data, but a new regularization framework achieves up to +16.5% OOD generalization gains by controlling prompt representation.
Large language models (LLMs) are highly sensitive to the prompts used to specify task objectives and behavioral constraints. Many recent prompt optimization methods iteratively rewrite prompts using LLM-generated feedback, but the resulting prompts often become longer, accumulate narrow sample-specific rules, and generalize poorly beyond the training distribution. We study this failure mode as prompt distributional overfitting and argue that it reflects a lack of representation control in discrete text-space optimization. We formalize this view through representational inefficiency, a dual-factor measure that decomposes prompt inefficiency into capacity cost and scope narrowness, attributing distributional prompt overfitting to their coupled growth during optimization. We propose TextReg, a regularization framework that realizes a soft-penalty objective through regularized textual gradients, combining Dual-Evidence Gradient Purification, Semantic Edit Regularization, and Regularization-Guided Prompt Update. Across multiple reasoning benchmarks, TextReg substantially improves out-of-distribution (OOD) generalization, with accuracy gains of up to +11.8% over TextGrad and +16.5% over REVOLVE.