Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces Orthogonal Representation Contribution Analysis (ORCA), a post-training interpretability framework for SVMs using truncated orthogonal polynomial kernels. By leveraging the finite-dimensional RKHS and its explicit orthonormal basis, ORCA decomposes the decision function into intrinsic RKHS coordinates. The framework uses normalized Orthogonal Kernel Contribution (OKC) indices to quantify the distribution of the classifier's squared RKHS norm across interaction orders, polynomial degrees, and feature contributions, revealing structural model complexity.
SVMs hide interpretable structure in their kernels: this method cracks them open to reveal feature interactions and model complexity without needing retraining.
We study post-training interpretability for Support Vector Machines (SVMs) built from truncated orthogonal polynomial kernels. Since the associated reproducing kernel Hilbert space is finite-dimensional and admits an explicit tensor-product orthonormal basis, the fitted decision function can be expanded exactly in intrinsic RKHS coordinates. This leads to Orthogonal Representation Contribution Analysis (ORCA), a diagnostic framework based on normalized Orthogonal Kernel Contribution (OKC) indices. These indices quantify how the squared RKHS norm of the classifier is distributed across interaction orders, total polynomial degrees, marginal coordinate effects, and pairwise contributions. The methodology is fully post-training and requires neither surrogate models nor retraining. We illustrate its diagnostic value on a synthetic double-spiral problem and on a real five-dimensional echocardiogram dataset. The results show that the proposed indices reveal structural aspects of model complexity that are not captured by predictive accuracy alone.