Towards incremental learning of nonstationary imbalanced data stream: A multiple selectively recursive approach
Document Type
Article
Date of Original Version
3-1-2011
Abstract
Difficulties of learning from nonstationary data stream are generally twofold. First, dynamically structured learning framework is required to catch up with the evolution of unstable class concepts, i. e., concept drifts. Second, imbalanced class distribution over data stream demands a mechanism to intensify the underrepresented class concepts for improved overall performance. To alleviate the challenges brought by these issues, we propose the recursive ensemble approach (REA) in this paper. To battle against the imbalanced learning problem in training data chunk received at any timestamp t, i. e., St REA adaptively pushes into St part of minority class examples received within [0, t - 1] to balance its skewed class distribution. Hypotheses are then progressively developed over time for all balanced training data chunks and combined together as an ensemble classifier in a dynamically weighted manner, which therefore addresses the concept drifts issue in time. Theoretical analysis proves that REA can provide less erroneous prediction results than a comparative algorithm. Besides that, empirical study on both synthetic benchmarks and real-world data set is also applied to validate effectiveness of REA as compared with other algorithms in terms of evaluation metrics consisting of overall prediction accuracy and ROC curve. © 2010 Springer-Verlag.
Publication Title, e.g., Journal
Evolving Systems
Volume
2
Issue
1
Citation/Publisher Attribution
He, Haibo, and Sheng Chen. "Towards incremental learning of nonstationary imbalanced data stream: A multiple selectively recursive approach." Evolving Systems 2, 1 (2011): 35-50. doi: 10.1007/s12530-010-9021-y.