Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces Simultaneous Latent Budget Trees (SLBT), a novel probabilistic framework designed for stratified classification that optimizes decision tree splits by integrating a control variable, such as demographic factors. By employing a model-based split rule that treats child nodes as latent components of a simultaneous mixture model, the authors enhance interpretability and performance in scenarios with unbalanced response distributions. The methodology is validated through an application to gender-related differences in Amyotrophic Lateral Sclerosis, showcasing its practical utility in medical research.
Stratified classification just got a boost—Simultaneous Latent Budget Trees can reveal hidden insights in complex datasets while maintaining interpretability.
In the era of Explainable Artificial Intelligence, there is a renewed focus on single trees for their ease of interpretation. This paper introduces Simultaneous Latent Budget Trees, a probabilistic machine learning framework for classification trees in the presence of a stratification factor such as a temporal, spatial, or demographic variable, acting as a control variable or potential confounder. Standard tree growth procedures are not designed to optimize a conditional split rule. A model-based split rule is proposed in which child nodes are interpreted as latent components of a simultaneous mixture model, such as the Simultaneous Latent Budget Model and its constrained versions, fitted to the parent node. Mixing parameters drive the observations, differently for each group, to the child nodes whereas latent budgets parameters update the response classes profile of each level of the control variable. Parameters are estimated by least squares considering a neural network perspective of the model. An informative tree structure can be interactively visualized with interpretation aids on the node and the paths, including visual pruning and decision tree selection procedure. Suitable measures are proposed to handle an unbalanced response class distribution. The proposed methodology is applied to investigate gender-related differences in disease progression of Amyotrophic Lateral Sclerosis. The SLBT library with the various tree-based algorithms is available in the linked GitHub repository.