Search papers, labs, and topics across Lattice.
This paper investigates the limitations of counterfactual tuning (CFT) for LLM unlearning, identifying knowledge conflict within counterfactual corpora and hallucination spillover as key weaknesses. They introduce RWKU+, an extended benchmark with novel metrics and gradient-level diagnostics, to systematically evaluate these issues. Experiments reveal that CFT underperforms due to conflicting gradients from inconsistent counterfactual data and an increased tendency to hallucinate in unrelated domains.
LLM unlearning via counterfactual tuning can backfire, increasing hallucination rates in unexpected areas due to inconsistencies in the "fake" knowledge it's trained on.
Counterfactual tuning (CFT) has emerged as a promising paradigm for Large Language Model (LLM) unlearning by training models to generate alternative fictitious knowledge in place of undesired content. However, in this work, we find that this paradigm still underperforms other paradigms in some aspects, and identify two previously overlooked pitfalls underlying this gap: (1) knowledge conflict, where mutual inconsistencies within counterfactual corpora induce conflicting gradients that disrupt parameter optimization, and (2) hallucination spillover, where fitting false targets instills a persistent fabrication bias, inflating hallucination rates on unrelated domains. To systematically diagnose these issues, we introduce RWKU+, an extended benchmark equipped with novel trade-off metrics and gradient-level diagnostic tools. Our work further discusses the limitations and overhead of the paradigm, aiming to provide insights and actionable guidance for more rigorous LLM unlearning research.
