Search papers, labs, and topics across Lattice.
This paper probes Vision-Language Models (VLMs) by constructing within-layer correlation graphs based on neuron co-activations to understand population-level computation. They find that these correlation topologies encode recoverable behavioral signals and that cross-modal structure consolidates with depth around recurrent hub neurons. Perturbing these hub neurons significantly alters model output, demonstrating their causal influence.
VLMs hide a surprisingly compact set of recurrent hub neurons that, when perturbed, can drastically alter model outputs, suggesting a new path for targeted interventions.
Vision-language models (VLMs) achieve strong multimodal performance, yet how computation is organized across populations of neurons remains poorly understood. In this work, we study VLMs through the lens of neural topology, representing each layer as a within-layer correlation graph derived from neuron-neuron co-activations. This view allows us to ask whether population-level structure is behaviorally meaningful, how it changes across modalities and depth, and whether it identifies causally influential internal components under intervention. We show that correlation topology carries recoverable behavioral signal; moreover, cross-modal structure progressively consolidates with depth around a compact set of recurrent hub neurons, whose targeted perturbation substantially alters model output. Neural topology thus emerges as a meaningful intermediate scale for VLM interpretability: richer than local attribution, more tractable than full circuit recovery, and empirically tied to multimodal behavior. Code is publicly available at https://github.com/he-h/vlm-graph-probing.
MIT CSAIL