【cv】Decision stumps||线性分段函数(piecewise linear function )||

最新推荐文章于 2024-08-01 21:25:05 发布

三少GG

最新推荐文章于 2024-08-01 21:25:05 发布

阅读量4.4k

点赞数

分类专栏： PKU Research 文章标签： function classification features training tree

本文链接：https://blog.csdn.net/pkueecser/article/details/6458893

版权

决策桩（Decision Stumps）是仅包含一个内部节点的决策树，基于单一输入特征进行预测。它们常作为弱学习器在集成学习方法如 Bagging 和 Boosting 中使用。线性分段函数则是通过多个阈值将连续特征划分成多个部分的函数。在机器学习中，决策桩的选择通常基于训练集上的准确度。本文探讨了这两种简单但有效的分类工具。

摘要由CSDN通过智能技术生成

1. Decision stumps的概念

http://www.answers.com/topic/decision-stump

A decision stump is a machine learning model consisting of a one-leveldecision tree.^[1] That is, it is a decision tree with one internal node (the root) which is immediately connected to the terminal nodes. A decision stump makes a prediction based on the value of just a single input feature. Sometimes they are also called1-rules.^[2]

Depending on the type of the input feature, several variations are possible. For nominal features, one may build a stump which contains a leaf for each possible feature value^[3]^[4] or a stump with the two leaves, one of which corresponds to some chosen category, and the other leaf to all the other categories.^[5] For binary features these two schemes are identical. A missing value may be treated as a yet another category.^[5]

For continuous features, usually, some threshold feature value is selected, and the stump contains two leaves — for values below and above the threshold. However, rarely, multiple thresholds may be chosen and the stump therefore contains three or more leaves.

Decision stumps are often