Search papers, labs, and topics across Lattice.
The paper introduces AdvSafe, a dual-adversarial framework designed to enhance the intrinsic threat comprehension of large reasoning models (LRMs) by explicitly deconstructing adversarial mechanisms. This approach involves a two-phase adversarial game where a teacher model is breached by dynamically crafted deceptive prompts, followed by a cognitive counter-attack that reveals the vulnerabilities of the attack. The results show that LRMs trained with only 1K synthesized samples from this process exhibit significantly improved robustness against jailbreaks while maintaining high reasoning utility, outperforming existing safety alignment methods.
AdvSafe enables LRMs to achieve jailbreak robustness with minimal utility loss by teaching them to understand and counteract adversarial threats intrinsically.
Large reasoning models (LRMs) achieve remarkable success on complex tasks but remain vulnerable to harmful prompts that induce unsafe outputs. Recent methods align LRMs using direct refusals or safety rationales, yet often focus on prompt patterns rather than intrinsic attack mechanisms. As a result, these pattern-centric alignments struggle to generalize across diverse jailbreaks, compromising adversarial robustness and reasoning utility. We propose AdvSafe, a dual-adversarial framework that enables LRMs to internalize unsafety knowledge by explicitly deconstructing adversarial mechanisms. This moves beyond pattern-dependent traces, fostering robust cognitive defense without compromising reasoning utility. Our pipeline operates via a two-phase adversarial game. First, in adversarial synthesis, an autonomous agent dynamically crafts deceptive jailbreak prompts, adapting its strategies to breach a strong teacher model. Second, in adversarial extraction, the breached teacher executes a cognitive counter-attack. For every successful jailbreak, the teacher unmasks the camouflage, explaining why the attack succeeds and how such prompts can be identified and mitigated. This dual-adversarial process yields a compact reasoning dataset capturing rich, generalizable unsafety knowledge. Student models trained on this dataset implicitly acquire safety alignment through intrinsic threat comprehension. Experiments show that with only 1K synthesized samples, AdvSafe-aligned LRMs achieve significantly stronger jailbreak robustness than existing baselines, with almost no utility degradation. Furthermore, AdvSafe improves robustness against out-of-distribution prompts, demonstrating that learning unsafety knowledge enables a superior robustness-utility trade-off and generalizes beyond seen attack patterns.
