Search papers, labs, and topics across Lattice.
The authors investigate whether soft inductive priors can act as temporary scaffolds during training by evaluating small Transformers with annealable positional attention biases on associative recall and Markov induction tasks. Determining whether functional circuits survive prior removal reveals whether inductive biases can guide models into minima they cannot reach on their own. While abrupt prior ablation causes retrieval performance to collapse from 0.772 to 0.095, continuous fade-to-zero annealing preserves an accuracy of 0.734, triggering downstream circuit consolidation that continues even after the prior is completely eliminated.
Removing an architectural prior abruptly tanks Transformer recall from 77% to 9%, but smoothly annealing it away allows the model to permanently consolidate the underlying circuit.
Soft positional priors can help small Transformers learn retrieval circuits, but it is unclear whether the resulting circuits remain functional once the prior is removed. We test this with an annealable soft-prior Transformer whose attention biases can be learned, faded, or zeroed during training and evaluation. On associative recall, unforced models perform well with the prior active ($0.772 \pm 0.020$) but collapse at zero gate ($0.095 \pm 0.009$). Smooth fade-to-zero training preserves high zero-gate accuracy ($0.734 \pm 0.028$), whereas forced-zero training, hard switching, and post hoc continuation fail to recover the same effect. The pattern also appears on Markov induction. Linear regression ICL provides a boundary case because zero-gate training can learn that task directly. Mechanistic traces show that circuit consolidation occurs after the gate reaches zero, even though the responsible heads vary across seeds. These results suggest that circuit removability in small discrete retrieval tasks depends on the training trajectory, not just the final architecture.
