Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces Continuous Adversarial Training for Consistent Honesty (CATCH), a novel method to mitigate dishonest behavior in LLMs by training them to produce honest outputs and avoid dishonest ones, inspired by adversarial refusal techniques. Evaluated on Llama-3.3-70B-Instruct and Qwen3-3.6-27B, CATCH significantly reduces dishonesty under pressure and increases self-reporting across diverse benchmarks with minimal utility loss. The approach demonstrates superior performance over prompting and supervised fine-tuning, and matches state-of-the-art honesty steering while preserving model utility through a curated dataset.
Hundreds of adversarial honesty targets are sufficient to teach LLMs to confess their hidden behaviors and resist pressure to lie, outperforming existing methods without sacrificing utility.
Large language models (LLMs) are becoming prevalent in scenarios where honesty is critical. However, despite alignment training, these models still exhibit dishonest behaviour, such as outputting claims that contradict some knowledge or are not supported by what is accessible in context. We introduce Continuous Adversarial Training for Consistent Honesty (CATCH), inspired by a method originally developed to robustly refuse harmful queries. CATCH trains the model towards an honest answer and away from a dishonest one while maintaining the model's capabilities. We evaluate two architectures (Llama-3.3-70B-Instruct and Qwen3-3.6-27B). We show that trained with only hundreds of targets built from self-reporting scenarios, CATCH learns an honest behaviour that robustly generalizes and transfers across distinct benchmarks. It consistently reduces dishonesty under pressure on MASK, increases confessions in the multi-agent game of Among Us, and improves the discovery rates of the model's hidden behaviours in AuditBench. We show that CATCH outperforms prompting and supervised fine-tuning in improving honesty, and it is on par with state-of-the-art honesty activation steering. However, CATCH surpasses honesty steering in maintaining utility, thanks to a novel choice of utility data.