Search papers, labs, and topics across Lattice.
This paper introduces Hoeffding Adaptive Splitting Trees, a novel approach that enhances ensemble learning for data stream classification by integrating periodic splitting with adaptive mechanisms that respond to performance degradation. The authors identify that traditional adaptive-splitting trees often fail to maintain diversity within ensembles, which can hinder performance in dynamic environments. Experimental results show that their proposed models significantly improve ensemble performance, achieving state-of-the-art results while effectively adapting to concept drift.
Adaptive splitting can boost ensemble diversity and performance, addressing a critical gap in existing decision tree models for data streams.
Ensembles of decision trees are well-established methods for data stream classification. In ensemble learning, Hoeffding Trees are widely adopted as base learners, performing periodic split attempts according to the Hoeffding bound. Recent studies, however, indicate that this standard splitting mechanism lacks adaptability, while adaptive trees that trigger splits in response to performance degradation have achieved superior results. In this paper, we identify limitations in the use of adaptive-splitting decision trees as ensemble base learners, showing that change detectors often fail to promote sufficient diversity within ensembles. To address this issue, we propose two novel decision tree models, termed Hoeffding Adaptive Splitting Trees. These models combine the periodic splitting strategy of Hoeffding Trees, which fosters ensemble diversity, with adaptive splitting mechanisms that employ change detection algorithms to identify performance decay and determine split points. Experimental results demonstrate that Hoeffding Adaptive Splitting Trees enhance ensemble performance and achieve state-of-the-art results across a comprehensive evaluation, including benchmark comparisons, computational cost analysis, and concept drift adaptation.
