一周算法实践day2：集成模型构建

数据说明

使用之前的数据data_all.csv

1任务

• 构建随机森林、GBDT、XGBoost和LightGBM这4个模型，评分方式任意。

2解决的问题

在程序编写完之后进行运行会出现多个警告：DeprecationWarning: The truth value of an empty array is ambiguous. Returning False, but in future this will result in an error. Use array.size > 0 to check that an array is not empty. if diff:
警告的意思是：空数组的真值是不明确的。返回False，但会导致错误。使用array.size> 0来检查数组是否为空。
解决： 忽略警告：由于numpy在空数组上弃用了真值检查而出现的警告，可以直接忽略这个问题，添加如下代码：

import warnings
warnings.filterwarnings("ignore")

以上警告则会消失。

3完整代码及注释

#导入包
from sklearn.ensemble import RandomForestClassifier
from sklearn.ensemble import GradientBoostingClassifier
from sklearn.model_selection import train_test_split
from xgboost import XGBClassifier
from lightgbm import LGBMClassifier
import pandas as pd
import warnings

#忽略警告：由于numpy在空数组上弃用了真值检查而出现的警告，可以直接忽略这个问题
#警告详情：DeprecationWarning: The truth value of an empty array is ambiguous. Returning False, but in future this will result in an error. Use `array.size > 0` to check that an array is not empty. if diff:
#翻译：空数组的真值是不明确的。返回False，但会导致错误。使用`array.size> 0`来检查数组是否为空。
warnings.filterwarnings("ignore")

#读取数据
data_all = pd.read_csv('data_all.csv')
print("数据行列数",data_all.shape)

#划分数据集
X = data_all.drop(['status'],axis=1)
#'status'列是标签
y = data_all['status']
X_train,X_test,y_train,y_test = train_test_split(X,y,test_size=0.3,random_state=2018)

#构建模型
#1.随机森林
rfc = RandomForestClassifier()
rfc.fit(X_train,y_train)
rfc_score = rfc.score(X_test,y_test)

#2.GBDT
gbc = GradientBoostingClassifier()
gbc.fit(X_train,y_train)
gbc_score = gbc.score(X_test,y_test)

#3.XGBoost
xgbc = XGBClassifier()
xgbc.fit(X_train,y_train)
xgbc_score = xgbc.score(X_test,y_test)

#4.LigthGBM
lgbc = LGBMClassifier()
lgbc.fit(X_train,y_train)
lgbc_score = lgbc.score(X_test,y_test)

print("RandomForestClassifier Acc: %f, GradientBoostingClassifier Acc: %f" %(rfc_score, gbc_score))
print("XGBClassifier Acc: %f, LGBMClassifier Acc: %f" %(xgbc_score, lgbc_score))

4运行结果展现

RandomForestClassifier Acc: 0.763139, GradientBoostingClassifier Acc: 0.779958
XGBClassifier Acc: 0.785564, LGBMClassifier Acc: 0.770147

5遇到的问题

程序运行之后还有一条警告未解决：DeprecationWarning: numpy.core.umath_tests is an internal NumPy module and should not be imported. It will be removed in a future NumPy release. from numpy.core.umath_tests import inner1d
该警告的意思是：umath_tests是一个内部NumPy模块，不应该导入。它将在未来的NumPy版本中被删除。
在百度查询之后也没能解决，有同学遇到相同的警告嘛？