Search papers, labs, and topics across Lattice.
This paper introduces the Prototypes for Interpretable Sequence Modeling (PRISM), a novel architecture for language models that utilizes a sparse, non-negative mixture of learned prototypes to enhance interpretability and training data attribution. By anchoring prototypes to coherent neighborhoods of training examples, PRISM achieves comparable or superior downstream accuracy to dense baselines while enabling a significant reduction in the cost of data attribution鈥攁pproximately 500 times faster than traditional methods. The architecture also allows for targeted modifications to model behavior without the need for finetuning, improving performance and interpretability simultaneously.
PRISM enables rapid and interpretable training data attribution, achieving 500x faster insights into model behavior while maintaining high accuracy.
Knowing which training examples drive outputs is fundamental to auditing, correcting, and understanding language models, yet for modern LLMs this remains expensive, approximate, and largely post-hoc. Standard language models generate tokens through a dense network pathway, causing training data's influence to be distributed across parameters rather than organized along explicit, traceable components. We introduce a prototype language model architecture, Prototypes for Interpretable Sequence Modeling (PRISM), that forms each prediction via a sparse, non-negative mixture of learned prototypes, trained with clustering objectives that anchor each prototype to coherent neighborhoods of training examples. Across architectures from 130M to 1.6B parameters trained on up to 50B tokens, prototype language models either surpass or remain within 2.5 percentage points on average downstream accuracy of matched dense baselines. We show that sparse prototype structure localizes curvature in the loss landscape, yielding a more tractable Hessian and enabling training data attribution that is ~500x faster than post hoc baselines when consuming equivalent memory. Calibrating linear prototype controllers can improve downstream accuracy by roughly 3 points while tracing those corrections back to training neighborhoods, and targeted prototype suppression can remove model behaviors without finetuning or measurable loss in generation quality.
