Search papers, labs, and topics across Lattice.
This paper introduces GLARE, an LLM-based interactive interface that allows users to query global explanations of black-box image classifiers using natural language. By translating user queries into structured SQL queries over local explanation data, GLARE enhances the accessibility and usability of complex model explanations without requiring users to understand low-level representations. Evaluation results indicate that this approach significantly improves intent interpretation and query mapping accuracy, making global explanations more practical for users seeking targeted insights.
Users can now access complex global explanations of vision models through simple natural language queries, transforming how we interact with black-box classifiers.
While global explanations are crucial for understanding vision models across datasets, classes, and decision contexts, their complex and monolithic nature often hinders practical exploration. Because users typically seek targeted answers to specific questions rather than static artifacts, we present an LLM-based interactive interface that provides natural language access to global explanations for black-box image classifiers. The system's core LLM acts as a mediator, translating natural language questions into structured SQL queries over local explanation data. This enables flexible aggregation without exposing users to low-level representations. For each query, the interface outputs statistics-augmented natural language responses, supporting local explanations, and intent-aligned visualizations. We evaluate the system on intent interpretation, query mapping accuracy, generalization to novel queries and datasets, and robustness to linguistic errors. Our results demonstrate that LLM-mediated querying substantially improves the accessibility and usability of global explanations for human-centered XAI.
