Track trials, findings, and clinical evidence as it lands.
Search papers, labs, and topics across Lattice.
Hide and Seek (HnS) addresses the limitation of concept-based attribution methods by enabling interpretation of black-box vision models without requiring model weights or concept-annotated datasets. The method iteratively retrieves concept-aligned images, localizes concepts, masks them, and measures attribution by observing changes in the black-box model's output. HnS demonstrates faithful, local attributions and superior agreement with ground truth compared to existing methods, extending concept attribution to tasks like image captioning and segmentation.
Concept-based attribution for any black-box vision model is now possible without model weights or concept datasets, even for generative tasks.
Interpreting machine learning model predictions is a central challenge, particularly for black-box vision models. Concept-based attribution methods interpret models using human-understandable concepts. Existing concept-based methods can only interpret classification and regression models. They require access to model weights or large concept-annotated datasets, and most methods cannot provide image-level attribution. We propose Hide and Seek (HnS), a new method for concept-level attribution that does not require access to model weights or labeled concept datasets. HnS can interpret a wide range of vision models. Given a concept and image set, HnS retrieves concept-aligned images using a vision-language model, localizes the concept within each image, masks the localized region, and measures attribution from the change in the black-box model's output between the original and masked images. This enables faithful attribution by directly measuring the model's behavior and supporting local attributions. We validated HnS on CelebA and COCO-Stuff. Compared to existing methods, HnS showed better agreement with ground-truth attributions. We demonstrated the applicability of HnS on diverse tasks, including image captioning and satellite image segmentation, where no existing concept attribution method can be used. We provided our anonymous code in the supplementary material.