How to adjust an ensemble size in stream data mining?

详细信息    查看全文

• 作者：Lena Pietruczuk ; ^{lena.pietruczuk@iisi.pcz.pl} ; Leszek Rutkowski ; Maciej Jaworski ; Piotr Duda
• 关键词：Stream data ; Data mining ; Classification ; Ensemble methods
• 刊名：Information Sciences
• 出版年：2017
• 出版时间：March 2017
• 年：2017
• 卷：381
• 期：Complete
• 页码：46-54
• 全文大小：485 K
• 卷排序：381

文摘

In this paper we propose a new approach for designing an ensemble applied to stream data classification. Our approach is supported by two theorems showing how to decide whether a new component should be added to the ensemble or not, based on the assumption that such an action should increase the accuracy of the ensemble not only for the current portion of observations but also for the whole (infinite) data stream. The conclusions of these theorems hold with a certain probability (confidence) set by the user. Through computer simulations, among others, we show that decreasing the confidence that decision based on the finite portion of the stream is the same as based on the whole (infinite) data stream only slightly improves the accuracy at the expense of significant memory consumption. Moreover, we will introduce a novel procedure of weighting ensemble components, i.e. decision trees, by assigning a weight to each leaf of the tree. In previous approaches a weight was assigned to the whole ensemble component. The new approach is based on the observation that probability of the correct tree outcome is different in various tree sections.