python中的adaboost分类器

In recent years, boosting algorithms got huge popularity in data science or machine learning competitions. Most of the winners of these competitions use boosting algorithms to achieve high accuracy. These Data science competitions provide the global platform for learning, exploring, and providing solutions for various business and government problems. Boosting algorithms combine multiple low accuracy(or weak) models to create a high accuracy(or strong) models. It can be utilized in various domains such as credit, insurance, marketing, and sales. Boosting algorithms such as AdaBoost, Gradient Boosting, and XGBoost are widely used machine learning algorithm to win the data science competitions. In this tutorial, you are going to learn the AdaBoost ensemble boosting algorithm and the following topics will be covered:

近年来，Boosting算法在数据科学或机器学习竞赛中广受欢迎。 这些比赛的大多数获胜者都使用增强算法来实现高精度。 这些数据科学竞赛为学习，探索和提供各种商业和政府问题的解决方案提供了全球平台。 Boosting算法结合了多个低精度(或弱)模型来创建高精度(或强)模型。 它可以用于信贷，保险，市场营销和销售等各个领域。 诸如AdaBoost，Gradient Boosting和XGBoost之类的Boosting算法被广泛用于机器学习算法中，以赢得数据科学竞赛的冠军。 在本教程中，您将学习AdaBoost集成提升算法，并将涵盖以下主题：

• Ensemble Machine Learning Approach
  集成机器学习方法
• AdaBoost Classifier
  AdaBoost分类器
• How does the AdaBoost algorithm work?
  AdaBoost算法如何工作？
• Building Model in Python
  用Python建立模型
• Pros and cons
  利弊
• Conclusion
  结论

For more such tutorials, projects, and courses visit DataCamp

有关更多此类教程，项目和课程的信息，请访问DataCamp

集成机器学习方法 (Ensemble Machine Learning Approach)

An ensemble is a composite model, combines a series of low performing classifiers with the aim of creating an improved classifier. Here, individual classifier vote and final prediction label returned that performs majority voting. Ensembles offer more accuracy than individual or base classifiers. Ensemble methods can parallelize by allocating each base learner to different-different machines. Finally, you can say, Ensemble learning methods are meta-algorithms that combine several machine learning methods into a single predictive model to increase performance. Ensemble methods can decrease variance using the bagging approach, bias using a boosting approach, or improve predictions using the stacking approach.

集成是一个组合模型，它结合了一系列性能不佳的分类器，目的是创建一个改进的分类器。 在此，返回了执行多数表决的单个分类器表决和最终预测标签。 集成提供比单个或基本分类器更高的准确性。 集成方法可以通过将每个基础学习者分配给不同的机器来并行化。 最后，您可以说，集成学习方法是一种元算法，它将几种机器学习方法组合到一个预测模型中以提高性能。 集成方法可以使用装袋方法减少方差，使用增强方法使用偏差，或者使用堆叠方法来改善预测。

1. Bagging stands for bootstrap aggregation. combines multiple learners in a way to reduce the variance of estimates. For example, random forest trains M Decision Tree, you can train M different trees on different random subsets of the data and perform voting for final prediction. Bagging ensembles methods are Random Forest and Extra Trees.

   套袋代表引导聚合。 以减少估计差异的方式组合了多个学习者。 例如，随机森林训练了M个决策树，您可以在数据的不同随机子集上训练M个不同的树，并对最终预测执行投票。 套袋合奏的方法是随机森林和多余的树木。

2. Boosting algorithms are a set of low accurate classifier to create a highly accurate classifier. Low accuracy classifier (or weak classifier) offers the accuracy better than the flipping of a coin. A highly accurate classifier( or strong classifier) offers an error rate close to 0. The boosting algorithm can track the model w