Search papers, labs, and topics across Lattice.
This paper introduces an interpretable framework for Out-of-Distribution (OOD) detection that leverages class-conditioned semantic perturbations to assess model prediction stability. By utilizing sparse autoencoders to derive class-specific concept vectors, the authors demonstrate that in-distribution samples maintain stability under perturbations, while OOD samples exhibit significant deviations. The key finding indicates that this method not only enhances OOD detection performance but also provides interpretable insights into model uncertainty, which is crucial for safe deployment in medical imaging applications.
Class-conditioned perturbations reveal that in-distribution samples remain stable while OOD samples diverge, offering a new lens on model uncertainty.
Deep neural networks have achieved remarkable performance across medical imaging tasks, yet their tendency to overgeneralize under distributional shifts poses a major obstacle to safe clinical deployment. Out-of-Distribution (OOD) detection methods aim to mitigate this risk, but most existing approaches rely on opaque internal signals with poorly understood semantic meaning, limiting trust in safety-critical settings. In this work, we propose an interpretable OOD detection framework that probes the stability of model predictions under class-conditioned semantic perturbations. Leveraging sparse autoencoders (SAEs), we learn class-specific concept vectors from in-distribution data that disentangle dense intermediate representations into sparse, semantically meaningful components. At inference, we perturb deeper-layer representations using the concept vectors associated with the model's predicted class and measure the class logits stability. We hypothesize that in-distribution samples exhibit low sensitivity to such perturbations, as their representations align with class-specific semantic directions, whereas OOD samples show amplified deviations due to representational misalignment. By framing OOD detection as a concept conditioned stability analysis, our approach provides both a discriminative OOD signal and an interpretable lens into the internal mechanisms driving model uncertainty, making it particularly suitable for high stakes medical applications.
