Bagging, Boosting, and Randomization对比

原始论文：An Experimental Comparison of Three Methods for Constructing Ensembles of Decision Trees: Bagging, Boosting, and Randomization

This paper compares the effectiveness of randomization, bagging, and boosting for
improving the performance of the decision-tree algorithm C4.5. The experiments show that in situations with little
or no classification noise, randomization is competitive with (and perhaps slightly superior to) bagging but not as
accurate as boosting. In situations with substantial classification noise, bagging is much better than boosting, and
sometimes better than randomization.
没有noise时，randomization和boosting效果相当，好于bagging；

有noise时，randomization和bagging效果相当，好于boosting；

因为这篇文章提出了randomization的想法，所以肯定要说randomization的好了。。。

The goal of ensemble learning methods is to construct a collection (an ensemble) of individual classifiers that are 【diverse】 and yet 【accurate】.

Adaboost.M1 (boosting by weighting)；原来.M1可能表示method 1。.M0是不是表示boosting by sampling？？？