Search papers, labs, and topics across Lattice.
This paper introduces Wrapper-Based Intent-Form Augmentation (WIFA), a novel method that enhances safety tuning for language models by pairing wrapped harmful prompts with structurally matched benign examples, eliminating the need for external supervision. The authors implement WIFA in two fine-tuning approaches: WIFA-Boost, which optimizes harmful refusal, and Anchored Group-Consistent Refusal Training (A-GCRT), which regulates decision scores across similar intent wrappers. Results show that WIFA-Boost achieves superior harmful refusal rates, while A-GCRT significantly decreases over-refusal rates on the OR-Bench dataset, outperforming baseline models.
WIFA reduces harmful refusal while minimizing benign over-refusal, achieving a remarkable drop in over-refusal rates from 25.7% to 17.4%.
Safety tuning can improve harmful refusal, but models may learn surface-form shortcuts: wrapped harmful prompts bypass safety, while similarly wrapped benign prompts are over-refused. We propose Wrapper-Based Intent-Form Augmentation (WIFA), an automatic intent-group augmentation method that pairs wrapped harmful examples with structurally matched wrapped benign counterexamples, requiring no external teacher or manual per-wrapper intent labels. We use WIFA as a common data layer for two complementary fine-tuning routes: WIFA-Boost, a two-stage high-safety recipe, and Anchored Group-Consistent Refusal Training (A-GCRT), which regularizes refusal/compliance decision scores across same-intent wrappers and anchors harmful and benign groups on opposite sides of a margin. In the Qwen setting, WIFA-Boost reaches the strongest transformed-harmful refusal, while A-GCRT reduces OR-Bench over-refusal from 25.7\% for the base model to 17.4\%; reproduced baselines do not match these operating points. Llama results and ablations over data structure, two-stage order, and A-GCRT components support this intent-group interpretation without claiming universal below-base over-refusal.
