Search papers, labs, and topics across Lattice.
This paper introduces process sidecars, a novel two-coefficient edit family designed to effectively revoke learned states in language models after a safety phase, addressing the complexities of memory direction changes during safety training. The authors demonstrate that their method recovers the counterfactual safety-only oracle with second-order accuracy, significantly outperforming naive task arithmetic and other baseline approaches in terms of refusal closure across three model evaluations. This advancement is crucial for ensuring that language models can safely forget unwanted memories while maintaining performance integrity in subsequent tasks.
Revoking learned states in language models can achieve second-order accuracy, drastically improving safety without sacrificing performance.
Language models are often adapted in stages: a public skill phase, a private memory phase, and a later safety phase that learns to refuse outputs tied to the remembered entities. Revoking the memory after the safety phase is not the same problem as subtracting the memory update: the later safety optimizer has transported the memory direction. We introduce process sidecars, a two-coefficient edit family $\hat胃(位,纬)=胃_{\mathrm{AMS}}-位螖_{\mathrm{M}}-纬\hat{R}_{\mathrm{S}\leftarrow\mathrm{M}}$, with $\hat{R}_{\mathrm{S}\leftarrow\mathrm{M}}=\hat{J}_{\mathrm{S},\varepsilon}(螖_{\mathrm{M}})-螖_{\mathrm{M}}$, where $\hat{J}_{\mathrm{S},\varepsilon}$ is a centered secant through the realized future AdamW safety-training process. The implementation uses $\varepsilon=1$ at the natural memory-edit scale; it reuses $胃_{\mathrm{AMS}}$ as the positive endpoint and computes one additional safety trace at $胃_{\mathrm{A}}-螖_{\mathrm{M}}$. We prove two things. First, the exact sidecar, using the true transported direction $R_{\mathrm{S}\leftarrow\mathrm{M}}$ rather than the secant estimate, at $(位,纬)=(1,1)$ recovers the counterfactual safety-only oracle $胃_{\mathrm{AS}}$ up to second order; the proof treats AdamW as an augmented-state map over parameters, first moments, and second moments. Second, this process information is necessary: whenever future safety training bends the memory direction, every scalar task-arithmetic edit leaves first-order counterfactual error, while the process-sidecar edit is second-order accurate. Across three models, the validation-selected 2D edit improves held-out refusal closure over naive task arithmetic in all trials, and over the $纬=位$ process-JVP subfamily, the diagonal slice of the cached 2D grid, in all paired trials.