Search papers, labs, and topics across Lattice.
The paper introduces Critical-CoT, a defense framework against reasoning-level backdoor attacks in LLMs, which are more difficult to detect than token-level attacks because the backdoored answers are plausible. Critical-CoT uses a two-stage fine-tuning process to instill critical thinking behaviors in LLMs, enabling them to identify and refuse to generate malicious reasoning steps. Experiments show that Critical-CoT provides strong robustness against both in-context learning and fine-tuning based backdoor attacks, with strong generalization across domains and tasks.
Reasoning-level backdoors can be neutralized by fine-tuning LLMs to develop critical thinking, providing a surprisingly effective defense against these subtle attacks.
Large Language Models (LLMs), despite their impressive capabilities across domains, have been shown to be vulnerable to backdoor attacks. Prior backdoor strategies predominantly operate at the token level, where an injected trigger causes the model to generate a specific target word, choice, or class (depending on the task). Recent advances, however, exploit the long-form reasoning tendencies of modern LLMs to conduct reasoning-level backdoors: once triggered, the victim model inserts one or more malicious reasoning steps into its chain-of-thought (CoT). These attacks are substantially harder to detect, as the backdoored answer remains plausible and consistent with the poisoned reasoning trajectory. Yet, defenses tailored to this type of backdoor remain largely unexplored. To bridge this gap, we propose Critical-CoT, a novel defense mechanism that conducts a two-stage fine-tuning (FT) process on LLMs to develop critical thinking behaviors, enabling them to automatically identify potential backdoors and refuse to generate malicious reasoning steps. Extensive experiments across multiple LLMs and datasets demonstrate that Critical-CoT provides strong robustness against both in-context learning-based and FT-based backdoor attacks. Notably, Critical-CoT exhibits strong cross-domain and cross-task generalization. Our code is available at hthttps://github.com/tuanvu171/Critical-CoT.
