Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
LINE, a novel training-free approach, uses LLMs and text-to-image generation in a closed loop to iteratively propose and refine open-vocabulary concept labels for individual neurons in vision models. By leveraging activation history to guide the LLM, LINE discovers more comprehensive and higher-order concepts compared to methods relying on predefined vocabularies. Experiments show LINE achieves state-of-the-art performance, improving AUC scores by up to 0.18 on ImageNet and discovering 29% more concepts than existing methods.
Forget predefined vocabularies: this method uses LLMs to discover nearly a third more concepts encoded by individual neurons in vision models.
Interpreting the concepts encoded by individual neurons in deep neural networks is a crucial step towards understanding their complex decision-making processes and ensuring AI safety. Despite recent progress in neuron labeling, existing methods often limit the search space to predefined concept vocabularies or produce overly specific descriptions that fail to capture higher-order, global concepts. We introduce LINE, a novel, training-free iterative approach tailored for open-vocabulary concept labeling in vision models. Operating in a strictly black-box setting, LINE leverages a large language model and a text-to-image generator to iteratively propose and refine concepts in a closed loop, guided by activation history. We demonstrate that LINE achieves state-of-the-art performance across multiple model architectures, yielding AUC improvements of up to 0.18 on ImageNet and 0.05 on Places365, while discovering, on average, 29% of new concepts missed by massive predefined vocabularies. Beyond identifying the top concept, LINE provides a complete generation history, which enables polysemanticity evaluation and produces supporting visual explanations that rival gradient-dependent activation maximization methods.