Search papers, labs, and topics across Lattice.
The paper introduces the Dual-Stream Transformer, an architecture that separates the residual stream into a token stream (attention updates) and a context stream (feed-forward network updates) to improve interpretability. They explore different mixing strategies between attention heads, ranging from fully independent to dense, and quantify the trade-off between interpretability and performance on language modeling tasks. The results show that a Kronecker mixing strategy achieves a good balance, incurring only a 2.5% increase in validation loss compared to standard transformers, while all configurations exhibit robustness under attention amplification.
Achieve transformer interpretability by disentangling token and context processing streams, with only a 2.5% performance hit using Kronecker mixing.
Standard transformers entangle all computation in a single residual stream, obscuring which components perform which functions. We introduce the Dual-Stream Transformer, which decomposes the residual stream into two functionally distinct components: a token stream updated by attention and a context stream updated by feed-forward networks. Information flow between attention heads is controlled through a hierarchy of mixing strategies, from fully independent (maximum interpretability) to dense (standard transformer behavior). This design exposes a tunable tradeoff between interpretability and performance. We measure this tradeoff on language modeling tasks at 29M parameters. Fully independent head mixing increases validation loss by 8\% relative to dense baselines. The recommended Kronecker mixing strategy, which permits scalar communication between heads while preserving within-head structure, costs only 2.5\%. All configurations maintain functional generation under attention amplification (scaling logits by factors up to 16 at inference time), with degradation ranging from 16\% to 27\%. This robustness suggests the architectures learn discrete algorithms that operate independently of soft probabilistic mixing. The architecture provides a foundation for interpretable language models where internal structure is exposed by design. \footnote{This work was partially supported by DARPA Contract HR001125C0302.}
