Search papers, labs, and topics across Lattice.
This paper introduces Qwen3-Instruct SAE, a suite of sparse autoencoders trained on the Qwen3 instruction-tuned model family, which includes various configurations (1.7B, 4B, and 8B). The authors address the computational challenges of training SAEs by systematically evaluating their performance across different activation sites, revealing trade-offs between sparsity and fidelity. Notably, the study demonstrates that specific SAE features can effectively influence instruction-tuned models to exhibit refusal behavior, providing a valuable resource for understanding sparse representations in language models.
Selected features from sparse autoencoders can causally steer language models toward desired behaviors, like refusal, revealing new avenues for interpretability and control.
Sparse autoencoders (SAEs) have emerged as a powerful tool for decomposing superposed language model representations into sparse and interpretable features. However, training SAEs is computationally expensive, and available open-source SAE models remain limited. In this work, we introduce \textbf{Qwen3-Instruct SAE}, a comprehensive suite of SAEs trained on the Qwen3 instruction-tuned model family, covering Qwen3-1.7B, Qwen3-4B, and Qwen3-8B. For Qwen3-1.7B and Qwen3-4B, we train layer-wise SAEs at three key activation sites: residual streams, MLP outputs, and attention outputs. For Qwen3-8B, we train SAEs on a subset of residual stream layers. We systematically evaluate these SAEs using both activation-level reconstruction metrics and model-level recovery metrics, revealing distinct sparsity--fidelity trade-offs across layers and components. Finally, we demonstrate the utility of Qwen3-Instruct SAE through a refusal-steering case study, showing that selected SAE features can causally steer instruction-tuned Qwen3 models toward refusal behavior. Our release provides a practical resource for studying sparse representations, feature-level mechanisms, and behavioral interventions in instruction-tuned language models
DAMO