Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This study investigates the production-perception distinction in large language models (LLMs) by measuring token probabilities generated under different prompt conditions. Using the Llama-3.1-8B model, the authors found that production-perception distances significantly exceeded production-production distances, with a consistent average ratio of approximately 1.8 across various models and prompts. The results indicate that the framing of prompts can induce a distinct production-perception effect in LLMs, challenging assumptions about their uniform processing mechanisms for input and output.
Prompt framing can create a striking production-perception distinction in LLMs, revealing that context influences token probabilities in unexpected ways.
The asymmetry between language production and perception has been well-documented in psycholinguistics. Whether large language models (LLMs) exhibit a functionally analogous distinction remains an open question, particularly given that LLMs rely on the same underlying mechanism (next-token prediction) for both input and output processing. In this exploratory study, we operationalize the production-perception distinction through direct token probability measurements rather than metalinguistic prompting. Using the base Llama-3.1-8B model, we generated poems under a production prompt and re-scored the same tokens under both rephrased production prompts and perception-oriented prompts. Across an extended experiment with four production and three perception prompts, production-perception distances consistently and substantially exceeded production-production distances, with non-overlapping ranges across conditions and an overall average ratio of approximately 1.8. Near-ceiling correlations in the production-production control confirm that the effect is specific to communicative framing rather than prompt surface variation, and we show the effect replicates across five open-weight models (Llama-3.1-8B, EuroLLM-9B, gemma-2-9b-it, Mistral-7B-Instruct-v0.3, and Qwen2.5-7B-Instruct), spanning both base and instruction-tuned variants. Temporal analysis revealed that the perception prompt exerts its strongest influence at the beginning of the sequence, with divergence decaying as generated context accumulates, though the specific shape of this decay varies across prompt pairs. These findings suggest that prompt framing alone induces a production-perception distinction in LLM probability distributions, even within a decoder-only architecture.