Search papers, labs, and topics across Lattice.
This paper introduces PragReST, a self-supervised framework designed to enhance pragmatic language understanding in large language models (LLMs) by generating counterfactual reasoning traces for training. The approach effectively constructs pragmatic question-answering data without the need for human-labeled datasets, utilizing both supervised fine-tuning and reinforcement learning. Results show that PragReST significantly outperforms existing models and baselines across four pragmatic benchmarks, with notable improvements in accuracy while maintaining general knowledge performance.
Counterfactual reasoning is the key to unlocking a 5.5% accuracy boost in pragmatic language understanding for LLMs, challenging their traditional reliance on literal interpretations.
Natural language understanding often depends on meanings that are implied rather than explicitly stated, requiring pragmatic reasoning. Despite strong performance on math and logical reasoning, large language models (LLMs) still struggle with making pragmatic inferences, often choosing literal interpretations. To improve LLM pragmatic reasoning, we introduce PragReST, a self-supervised framework that constructs pragmatic QA data, generates counterfactual reasoning traces, and trains models to internalize them through supervised fine-tuning and reinforcement learning, without human-labeled training data or distillation from a stronger teacher. Across four pragmatic benchmarks (PragMega, Ludwig, MetoQA, and AltPrag), PragReST improves over backbone models, task-specific pragmatic tuning baselines, and non-counterfactual variants of the same pipeline. On accuracy-based benchmarks, PragReST improves over the instruct backbone by 5.37 and 5.50% (absolute) for Qwen3-8B and Qwen3-14B, respectively. Our error analysis and ablations underscore the importance of counterfactual reasoning: PragReST primarily reduces errors caused by failures to contrast observed utterances with plausible alternatives, and removing counterfactual reasoning substantially reduces performance. Moreover, our training preserves out-of-domain performance on general-knowledge and mathematical reasoning benchmarks.
