Search papers, labs, and topics across Lattice.
This paper introduces Continuous LatEnt Adapter Routing (CLEAR), a novel framework designed to enhance the safety of large language models (LLMs) without compromising their utility. By employing a lightweight hidden-state gate to modulate the activation of a safety low-rank adapter, CLEAR effectively minimizes harmful outputs while preserving performance on benign prompts. Experimental results demonstrate that CLEAR significantly reduces harmful completions on the HarmBench benchmark and achieves higher accuracy on the GSM8K task compared to traditional globally applied safety tuning methods.
CLEAR slashes harmful completions from 32.3% to just 0.5% while boosting utility performance, redefining the safety-utility balance in LLMs.
Improving the safety of large language models (LLMs) often comes at the expense of utility, as globally applied safety tuning may affect model responses to both harmful and benign inputs. We propose Continuous LatEnt Adapter Routing (CLEAR), a conditional safety adaptation framework that uses a lightweight hidden-state gate to continuously control the activation strength of a safety low-rank adapter. CLEAR aims to reduce harmful completions while avoiding unnecessary changes to the frozen backbone that could degrade performance on benign prompts. Experiments on widely used safety and utility benchmarks show that CLEAR improves robustness on HarmBench while reducing the utility degradation observed with globally applied safety tuning such as SFT or standard low-rank adaptation (LoRA). On Llama-3-8B-Instruct, CLEAR reduces HarmBench ASR from 32.3\% to 0.5\%, while retaining most of the base model's utility and achieving up to 7.1 percentage points higher GSM8K accuracy than globally applied SFT or LoRA. These results suggest that CLEAR is a promising mechanism for improving the safety--utility trade-off in LLM alignment.
Stanford HAI