Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper investigates the robustness and consistency of attribution methods (Grad-CAM, LIME, pixel masking) in deep neural networks trained to predict human judgments of image authenticity. The study found that while several architectures achieved high accuracy in predicting human ratings, their attribution maps showed weak agreement across different architectures, even with similar predictive performance. Ensembling models improved prediction but did not lead to identifiable explanations, suggesting that successful models of behavior do not necessarily reveal underlying cognitive mechanisms.
Even when deep nets nail human judgments of image authenticity, their explanations wildly disagree, casting doubt on using model attributions to reverse-engineer human cognition.
Deep neural networks can predict human judgments, but this does not imply that they rely on human-like information or reveal the cues underlying those judgments. Prior work has addressed this issue using attribution heatmaps, but their explanatory value in itself depends on robustness. Here we tested the robustness of such explanations by evaluating whether models that predict human authenticity ratings also produce consistent explanations within and across architectures. We fit lightweight regression heads to multiple frozen pretrained vision models and generated attribution maps using Grad-CAM, LIME, and multiscale pixel masking. Several architectures predicted ratings well, reaching about 80% of the noise ceiling. VGG models achieved this by tracking image quality rather than authenticity-specific variance, limiting the relevance of their attributions. Among the remaining models, attribution maps were generally stable across random seeds within an architecture, especially for EfficientNetB3 and Barlow Twins, and consistency was higher for images judged as more authentic. Crucially, agreement in attribution across architectures was weak even when predictive performance was similar. To address this, we combined models in ensembles, which improved prediction of human authenticity judgments and enabled image-level attribution via pixel masking. We conclude that while deep networks can predict human authenticity judgments well, they do not produce identifiable explanations for those judgments. More broadly, our findings suggest that post hoc explanations from successful models of behavior should be treated as weak evidence for cognitive mechanism.