Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
The authors conduct a rigorous, matched evaluation comparing representation engineering techniques against standard behavioral safeguards across safety control (representation steering vs. Direct Preference Optimization) and safety monitoring (activation probes vs. external text classifiers). Despite widespread enthusiasm for mechanistic internal edits, a standardized comparison establishing when internal interventions actually outperform external baselines has been lacking. The study reveals that while DPO and external text monitors lead in high-data regimes and overall accuracy, representation probes offer competitive monitoring at drastically lower compute costs, and hybrid monitor-guided interventions can uniquely recover safety lost during downstream benign fine-tuning.
Internal activation steering cannot displace standard alignment at scale, but lightweight internal probes paired with runtime interventions rescue models from the safety degradation caused by downstream fine-tuning at near-zero marginal inference cost.
Reliable AI safeguards require both control mechanisms that reduce unsafe behavior and monitoring mechanisms that detect safety risks during model interactions. Established behavioral safeguards include alignment methods that optimize model outputs and text monitors that assess interaction text. Representation engineering instead reads or modifies internal model states, but the relative strengths of these approaches remain unclear because they are often evaluated under different settings. We present a matched evaluation across two tracks. For safety control, we compare DPO, a behavioral alignment method, with three representation steering methods across robustness, practicality, and granularity. DPO provides the strongest overall control and generally improves with increasing training data, although its safety can degrade after subsequent benign fine-tuning. Representation steering remains competitive primarily in low-data settings, particularly with high-quality contrastive data. For safety monitoring, we compare representation probes with fine-tuned and open-weight text monitors across full-response detection, early detection, and computational cost. Specialized text monitors achieve the strongest overall detection accuracy, while representation probes remain competitive at substantially lower marginal cost. Finally, monitor-guided interventions recover much of the safety lost by DPO after benign fine-tuning, with little additional over-refusal. Overall, representation engineering does not generally replace behavioral safeguards, but offers practical advantages under specific conditions and can provide complementary safety benefits.