Search papers, labs, and topics across Lattice.
This paper introduces Persistent Sparse Autoencoders (Persistent SAEs), which enhance standard sparse autoencoders by incorporating a persistence coefficient for each feature, enabling the model to learn the duration of feature relevance across sequences. The experiments demonstrate that Persistent SAEs maintain competitive reconstruction quality while effectively capturing a range of feature timescales, with fast features acting as interpretable detectors and slow features encapsulating topic-level information. Notably, in a prompt-injection monitoring case study, slow features were shown to retain detection signals over extended contexts, highlighting their potential for improved interpretability and monitoring of language models.
Slow features in Persistent SAEs can maintain detection signals over long contexts, revolutionizing how we interpret and monitor language models.
Sparse autoencoders (SAEs) decompose language model activations into sparse features, but standard SAEs encode each token independently and do not expose information that persists across a sequence. We introduce Persistent Sparse Autoencoders (Persistent SAEs), which extend standard SAEs by learning a persistence coefficient for each feature, allowing the model to learn which features should persist and for how long. Our experiments show that they retain competitive reconstruction quality while learning a spectrum of feature timescales: fast features behave as locally interpretable detectors, whereas slow features concentrate topic-level information in a persistent state. Moreover, as shown in a prompt-injection monitoring case study, slow features preserve detection signals and remain causally effective over long contexts. These results suggest that Persistent SAEs open up new opportunities for interpreting and monitoring language models through persistent semantic representations.
