Search papers, labs, and topics across Lattice.
UNBOX is introduced as a novel framework for dissecting black-box visual models without requiring data, gradients, or backpropagation. It uses Large Language Models and text-to-image diffusion models to perform activation maximization as a semantic search driven by output probabilities, generating human-interpretable text descriptors for each class. Experiments on ImageNet-1K, Waterbirds, and CelebA demonstrate that UNBOX achieves competitive performance with white-box interpretability methods, revealing learned concepts and potential biases.
You can now audit black-box vision models for biases and failure modes using only their output probabilities, thanks to a clever LLM-powered semantic search.
Ensuring trustworthiness in open-world visual recognition requires models that are interpretable, fair, and robust to distribution shifts. Yet modern vision systems are increasingly deployed as proprietary black-box APIs, exposing only output probabilities and hiding architecture, parameters, gradients, and training data. This opacity prevents meaningful auditing, bias detection, and failure analysis. Existing explanation methods assume white- or gray-box access or knowledge of the training distribution, making them unusable in these real-world settings. We introduce UNBOX, a framework for class-wise model dissection under fully data-free, gradient-free, and backpropagation-free constraints. UNBOX leverages Large Language Models and text-to-image diffusion models to recast activation maximization as a purely semantic search driven by output probabilities. The method produces human-interpretable text descriptors that maximally activate each class, revealing the concepts a model has implicitly learned, the training distribution it reflects, and potential sources of bias. We evaluate UNBOX on ImageNet-1K, Waterbirds, and CelebA through semantic fidelity tests, visual-feature correlation analyses and slice-discovery auditing. Despite operating under the strictest black-box constraints, UNBOX performs competitively with state-of-the-art white-box interpretability methods. This demonstrates that meaningful insight into a model's internal reasoning can be recovered without any internal access, enabling more trustworthy and accountable visual recognition systems.
