Search papers, labs, and topics across Lattice.
This paper reinterprets the leaf values in gradient-boosted ensembles as coordinates in a high-dimensional space, enabling exact contrastive explanations for model predictions. By treating instances as points in R^M, the authors demonstrate that the differences between predictions can be traced back to a few key coordinates, corresponding to specific splits in the decision trees. The proposed recourse method not only achieves remarkable precision in reconstructing model decisions but also significantly improves the practicality of recommendations by ensuring they are actionable for users.
Contrastive explanations for gradient-boosted ensembles can now be exact, revealing how a handful of decision splits drive model predictions.
A gradient-boosted ensemble predicts by summing one leaf value per tree. Read those values as coordinates rather than as intermediate results, and every instance becomes a point in R^M on which the model acts linearly: the score is the sum of the coordinates. This small change of view makes contrastive explanation exact. The difference between two instances is a vector that is identically zero wherever they share a leaf, so the gap between a rejected applicant and an accepted one is carried by a handful of coordinates, each traceable to a real split in a real tree. Nothing is fitted, sampled, or assumed additive in features -- the additivity is already there, in the right space. We build a recourse method on this representation and evaluate it on five tabular datasets under repeated cross-validation. Its recommendation reconstructs the model's own decision to 6.2 x 10^-15, so an auditor can re-check the arithmetic without the model. On the credit datasets it is Pareto-non-dominated on effort against realism. And when recommendations are restricted to changes the subject could actually make -- not their age, not a settled delinquency -- it retains 58% of its validity where the strongest baseline retains 41%, a distinction the standard evaluation cannot see because it never asks whether a recommendation can be carried out.
