Search papers, labs, and topics across Lattice.
This paper addresses the challenge of generating human-readable prompts for large language models (LLMs) by reformulating the prompt optimization task as a Bayesian posterior inference problem. The authors introduce BayesPrompt, an efficient algorithm that samples prompts that achieve low perplexity while maintaining interpretability. Experimental results demonstrate significant improvements in prompt quality compared to existing state-of-the-art methods across various metrics.
Human-readable prompts can be generated with significantly lower perplexity using a novel Bayesian approach, transforming how we interact with LLMs.
Reconstructing prompts that can elicit a desired answer or behaviour in an LLM is an open and important research topic. Optimisation methods which aim at minimising the perplexity of a given answer, however, consistently yield so-called pseudoprompts, unintelligible strings of tokens which can lack human interpretability. We argue that this is a consequence of the ill-posedness of the prompt optimisation task. By reframing the task as a Bayesian posterior inference over prompts, we propose an efficient algorithm to sample prompts which are both efficient (in terms of perplexity) and human readable. We compare our approach with state of the art alternatives showing on a real data set a marked improvement over a range of metrics.
