Search papers, labs, and topics across Lattice.
This paper identifies and addresses the issue of "Prompt Privilege," where users with advanced prompting skills receive superior responses from large language models (LLMs) despite having similar underlying intents. To tackle this, the authors introduce a unified framework that includes the Prompt Equity Score (PES) for measuring performance disparities and the Prompt Equity Transformer (PET), which reformulates user prompts into accessibility-optimized versions without altering their intent. Experiments reveal significant performance gaps between low-literacy users and expert prompt engineers, but the application of PET effectively mitigates these disparities, enhancing equitable access to AI systems.
Users with less prompting expertise face significant performance penalties in LLM interactions, but a new AI-driven solution can level the playing field.
Large language models (LLMs) are increasingly integrated into healthcare, education, public services, and everyday decision making. They should provide comparable assistance regardless of a user's literacy, communication style, or prompt-engineering expertise. However, existing research on prompt robustness primarily focuses on adversarial attacks, prompt injection, and prompt optimization, while overlooking whether semantically equivalent requests receive different responses simply because they are phrased differently. We refer to this accessibility challenge as "Prompt Privilege": users with greater prompting expertise systematically obtain better model performance despite expressing the same underlying intent. To address this problem, we present a unified framework for measuring and mitigating accessibility disparities in LLM interactions. We introduce Prompt Equity Score (PES), a quantitative metric for evaluating performance consistency across user populations, and Prompt Equity Transformer (PET), an LLM-based agent that automatically transforms user requests into semantically equivalent, accessibility-oriented prompts while preserving their intent. PET shifts prompt optimization from the user to the AI system, functioning as an intelligent accessibility layer between users and foundation models. Experiments on the MedQA benchmark demonstrate measurable prompt privilege, with statistically significant performance disparities between low-literacy and expert-prompting cohorts. Applying PET eliminates these disparities while preserving semantic fidelity, demonstrating that accessibility-oriented prompt normalization can improve equitable AI access. By introducing prompt privilege as a new dimension of AI accessibility and PET as a practical solution, this work advances system-centered accessibility and provides a foundation for more fair, trustworthy, and inclusive AI systems.
