Search papers, labs, and topics across Lattice.
This paper introduces DMDIntel, a novel method that applies dynamic mode decomposition (DMD) to enhance the interpretability of predictions made by large language models (LLMs) in classification tasks. By decomposing the hidden states of LLMs into significant patterns and ranking input tokens based on their contributions to these modes, DMDIntel provides a more effective attribution mechanism. Experimental results across three datasets and model families demonstrate that DMDIntel significantly outperforms existing state-of-the-art interpretability techniques, including principal component analysis, integrated gradients, and SHAP.
DMDIntel reveals that LLMs can be interpreted with greater accuracy by leveraging dynamic mode decomposition, outperforming traditional methods in token attribution.
In this work, we introduce DMDIntel which uses dynamic mode decomposition (DMD) to make the predictions made by LLMs in a classification task interpretable. It develops an input attribution pipeline, that first decomposes the hidden states of an LLM into prominent patterns, also known as modes, and then associates ranks to the input tokens based on the projection values on those modes. Rigorous experiments across three datasets and three model families consistently show that the ranked attribution of input tokens obtained using DMDIntel by far outperforms state-of-the-art techniques such as principal component analysis, integrated gradients and SHAP.
