Search papers, labs, and topics across Lattice.
This study investigates the structural property of functional sparsity in Multimodal Large Language Models (MLLMs) by focusing on a specialized subset of attention heads known as Context-aware Retrieval (CoRe) heads. Using a novel metric called Retrieval Attention Mass (RAM), the authors demonstrate that CoRe heads serve as dedicated information extractors, crucial for effective multimodal reasoning, while other heads distribute attention more broadly. The research reveals that ablating the top 5% of CoRe heads significantly degrades performance, highlighting their essential role and suggesting that leveraging this sparsity can enhance inference speed without sacrificing accuracy.
Ablating just 5% of specialized CoRe heads leads to a dramatic drop in multimodal reasoning performance, revealing their critical role in MLLMs.
While Multimodal Large Language Models (MLLMs) demonstrate remarkable proficiency on complex vision-language tasks, the mechanisms by which they extract query-relevant visual features from complex, noisy contexts remain opaque. In this paper, we present an in-depth interpretability study that uncovers a profound structural property within MLLMs: functional sparsity in cross-modal retrieval. Leveraging a token-level metric termed Retrieval Attention Mass (RAM), we identify and characterize a highly specialized subset of attention heads, referred to as Context-aware Retrieval (CoRe) heads. Across diverse visual domains and model scales, we observe a clear functional division: CoRe heads act as dedicated information extractors, while most other heads distribute attention over broader contextual regions. Causal interventions further demonstrate the necessity of these specialized heads. Ablating only the top 5% of CoRe heads causes significant degradation in multimodal reasoning performance, whereas ablating lower-ranked heads has minimal effect. Moreover, acceleration experiments validate the utility of CoRe heads, showing that leveraging this localized sparsity significantly accelerates inference while maintaining robust task performance. Our findings reveal a structural principle of functional sparsity within MLLMs, refining the current understanding of mechanistic interpretability and laying a theoretical foundation that can inspire future architecture design and model optimization.
