Search papers, labs, and topics across Lattice.
This paper reinterprets CNNs as Self-Explainable Models (SEMs) and enhances their explainability by replacing the final linear layer with a k-means-based classifier. They formalize k-means-based post-hoc explanations for different layers of the CNN, including combinations of intermediate feature activations to generate concept-based explanation maps. Experiments on ResNet34 demonstrate that using shallower feature activations (B234) improves semantic fidelity of explanations, albeit with a minor drop in predictive performance.
CNNs can be made more interpretable without sacrificing too much accuracy by swapping the final layer for k-means and visualizing activations from multiple earlier blocks.
Although standard Convolutional Neural Networks (CNNs) can be mathematically reinterpreted as Self-Explainable Models (SEMs), their built-in prototypes do not on their own accurately represent the data. Replacing the final linear layer with a $k$-means-based classifier addresses this limitation without compromising performance. This work introduces a common formalization of $k$-means-based post-hoc explanations for the classifier, the encoder's final output (B4), and combinations of intermediate feature activations. The latter approach leverages the spatial consistency of convolutional receptive fields to generate concept-based explanation maps, which are supported by gradient-free feature attribution maps. Empirical evaluation with a ResNet34 shows that using shallower, less compressed feature activations, such as those from the last three blocks (B234), results in a trade-off between semantic fidelity and a slight reduction in predictive performance.
