博客讨论了使用Python sklearn的RandomForestClassifier遇到的过拟合问题。通过交叉验证显示训练集准确率高而测试集准确率低。作者提到可能的解决方案包括增加`n_estimators`数量，减少`max_features`，限制`max_depth`，以及设置`min_samples_leaf`大于1。建议采用科学的方法调整参数，如使用训练集、开发集和测试集，并逐一更改参数或利用gridsearch进行参数搜索。
I am using RandomForestClassifier implemented in python sklearn package to build a binary classification model. The below is the results of cross validations:
Fold 1 : Train: 164 Test: 40
Train Accuracy: 0.914634146341
Test Accuracy: 0.55
Fold 2 : Train: 163 Test: 41
Train Accuracy: 0.871165644172
Test Accuracy: 0.707317073171
Fold 3 : Train: 163 Test: 41
Train Accuracy: 0.889570552147
Test Accuracy: 0.585365853659
Fold 4 : Train: 163 Test: 41
Train Accuracy: 0.871165644172
Test Accuracy: 0.756097560976
Fold 5 : Train: 163 Test: 41
Train Accuracy: 0.883435582822
Test Accuracy: 0.512195121951
I am using "Price" feature to predict "quality" which is a ordinal value. In each cross validation, there are 163 training examples and 41 test examples.
最低0.47元/天 解锁文章
5215
被折叠的 条评论
为什么被折叠?
到【灌水乐园】发言
