Search papers, labs, and topics across Lattice.
This paper introduces PsychoSafe, a framework designed to elicit psychologically-informed refusals from large language models (LLMs) in high-risk scenarios. By constructing a corpus of 8019 prompt-response pairs across five risk domains and employing parameter-efficient fine-tuning on Qwen 3.5 27B, the authors demonstrate a significant improvement in refusal quality—28.1% over a generic baseline—while maintaining performance on non-refusal tasks. Notably, the framework excels in external resource referral and psychological grounding, indicating its potential to balance helpfulness with harm prevention in sensitive interactions.
Refusals from LLMs can be transformed into supportive communications that not only prevent harm but also guide users toward helpful resources.
Large language models (LLMs) routinely face requests that should be refused, creating a trade-off between helpfulness and harm prevention. However, refusals themselves can be helpful. In high-risk interactions involving crisis, coercion, or escalating intent, blunt non-compliance may prevent direct harm while still failing to support the needs of the person behind the request. We present PsychoSafe, a psychologically-informed refusal framework that reframes refusal as structured supportive communication grounded in evidence-based intervention strategies. To develop PsychoSafe, we construct a corpus of 8019 prompt-response pairs spanning five psychologically salient risk domains and apply prompting and parameter-efficient fine-tuning to Qwen 3.5 27B. On a balanced validation set of 500 prompts, evaluated with an LLM judge and validated through human ratings, PsychoSafe prompting improves overall refusal quality by 28.1% over a generic baseline, with particularly strong gains in external resource referral (+46.8%) and psychological grounding (+34.8%), while preserving downstream performance on non-refusal tasks. Fine-tuning achieves near-perfect refusal and resource-referral rates but reduces response relevance. Additional evaluations on SORRY-Bench and XSTest show strong in-domain robustness but limited out-of-domain generalization, suggesting that future work should diversify fine-tuning data to help models apply interventions selectively rather than schematically.
