Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces RoTRAG, a retrieval-augmented framework that enhances harm detection in multi-turn dialogues by integrating human-written moral norms, termed Rules of Thumb (RoTs), into the reasoning process of large language models (LLMs). By retrieving relevant RoTs for each conversational turn, RoTRAG provides explicit normative grounding that improves the interpretability and consistency of harm assessments. Experimental results demonstrate that RoTRAG achieves a 40% average relative gain in F1 score and reduces distributional error by 8.4%, while also minimizing redundant computation across dialogue turns.
Grounding LLM harm assessments in human moral norms can boost classification accuracy by 40% while cutting down on unnecessary computations.
Detecting harmful content in multi turn dialogue requires reasoning over the full conversational context rather than isolated utterances. However, most existing methods rely mainly on models internal parametric knowledge, without explicit grounding in external normative principles. This often leads to inconsistent judgments in socially nuanced contexts, limited interpretability, and redundant reasoning across turns. To address this, we propose RoTRAG, a retrieval augmented framework that incorporates concise human written moral norms, called Rules of Thumb (RoTs), into LLM based harm assessment. For each turn, RoTRAG retrieves relevant RoTs from an external corpus and uses them as explicit normative evidence for turn level reasoning and final severity classification. To improve efficiency, we further introduce a lightweight binary routing classifier that decides whether a new turn requires retrieval grounded reasoning or can reuse existing context. Experiments on ProsocialDialog and Safety Reasoning Multi Turn Dialogue show that RoTRAG consistently improves both harm classification and severity estimation over competitive baselines, with an average relative gain of around 40% in F1 across benchmark datasets and an average relative reduction of 8.4% in distributional error, while reducing redundant computation without sacrificing performance.