Track papers across labs, topics, and trends.
Search papers, labs, and topics across Lattice.
This paper introduces a stochastic-control perspective on CART random forests, termed CART-ROSA, by interpreting feature subsampling as random feasible action sets and the CART split rule as a masked-action allocation policy. This representation decomposes the forest's MSE into informative-opportunity rate and within-mask split policy contraction strength, offering insights into the algorithm's mechanics. The analysis reveals that while the CART policy is locally stabilizing, it can be globally suboptimal for the forest objective, and a MSE risk expansion is derived for the linear model.
CART random forests, often treated as black boxes, are surprisingly amenable to stochastic control analysis, revealing a tension between local stability and global optimality.
CART random forests are among the most widely used modern predictive methods, with well-documented empirical success. Yet, at the mechanistic level, the algorithm is often treated as a black box because of its complexity. In this paper, we develop a stochastic-control perspective on feature-subsampled CART random forests, named CART random opportunity-set allocation (CART-ROSA). At each node, the random subset of features is interpreted as a random feasible action set, and the CART split rule as a masked-action allocation policy. This policy induces a controlled stochastic process over informative split-count states, whose terminal law determines both single-tree error and cross-tree interaction terms in the forest mean squared error (MSE). Such representation opens the black box of CART-forests by separating two design levers: the informative-opportunity rate induced by feature subsampling, and the contraction strength from the within-mask split policy. We establish that the CART policy is locally stabilizing: it contracts imbalances in informative split allocations and concentrates terminal tree geometry. At the system level, however, it can be globally suboptimal for the forest objective. Specializing to the linear model, we derive the MSE risk expansion explicitly. Our results show how an operations-research perspective makes tractable a theoretical gap difficult to access from the standard algorithmic description of CART forests.