Search papers, labs, and topics across Lattice.
This paper introduces KANEx, a novel framework that integrates Kolmogorov-Arnold Networks (KANs) with Vision-Language Models (VLMs) to enhance the interpretability of medical image classifiers. By leveraging the symbolic transparency of KANs, the authors develop KAN-Map, a new method for generating saliency maps that directly reflect the KAN architecture rather than relying on gradient-based approximations. The results on the MIMIC-CXR dataset show a 10% improvement in visual localization and downstream reasoning quality, underscoring the importance of mathematical interpretability in building trust in medical AI systems.
Grounding linguistic explanations in mathematically interpretable units can boost the trustworthiness of AI in medical applications by enhancing both visual localization and reasoning quality.
Computer vision models have become highly effective for medical applications, yet their black-box nature continues to undermine clinician trust. In clinical workflows, chest X-ray classifiers are increasingly paired with Vision-Language Models (VLMs) to generate natural-language explanations. However, these systems add linguistic fluency without addressing the underlying opacity of the visual model. With the emergence of Kolmogorov-Arnold Networks (KANs), whose spline-based components provide inherently interpretable functional units, we investigate whether this architectural transparency can be leveraged to produce more trustworthy textual explanations. We introduce KANEx, the first ever framework that leverages the symbolic transparency of KANs to ground VLM reasoning. This interpretability also made it possible to design KAN-Map, a novel heatmap generation method derived directly from KAN models rather than gradient approximations. We feed these grounded contexts into downstream VLMs for enhanced explainability. Benchmarked on the MIMIC-CXR dataset, we demonstrate that KAN-based architectures with ResNet/ViT baselines demonstrate improved semantic similarity while producing significantly more faithful saliency maps. KAN architectures improve visual localization and downstream reasoning quality by 10%. Our findings suggest that grounding linguistic explanations and visual attributions in mathematically interpretable units is a necessary step toward trustworthy medical AI.
Stanford HAI