机器学习之分类模型

“”"
Iris 鸢尾花数据集是一个经典数据集，在统计学习和机器学习领域都经常被用作示例。数据集内包含 3 类共 150 条记录，每类各 50 个数据，每条记录都有 4 项特征：花萼长度、花萼宽度、花瓣长度、花瓣宽度，可以通过这4个特征预测鸢尾花卉属于（iris-setosa, iris-versicolour, iris-virginica）中的哪一品种。
以下是使用逻辑回归，决策树，随机森林，朴素贝叶斯，支持向量机SVM，
这几个模型，对数据进行训练和测试 。随后对模型进行评估。（参数没怎么系统的调节。）
“”"

# -*- coding:utf-8 -*-
__author__ = 'Cheney'
__email__ = 'cheneycp@outlook.com'
__date__ = '2019/11/15 22:44'

"""
    鸢尾花数据集.分类模型选择
"""
import sklearn.datasets as sd
import sklearn.linear_model as lm
import sklearn.model_selection as ms
import sklearn.metrics as sm
import sklearn.ensemble as se
import sklearn.tree as st
import sklearn.svm as svm
import sklearn.naive_bayes as nb

# 获取数据
iris = sd.load_iris()
x = iris.data
y = iris.target
target_names = iris.target_names
feature_names = iris.feature_names
# 训练集和测试集划分
train_x, test_x, train_y, test_y = ms.train_test_split(x, y, test_size=0.25, random_state=6)

# 逻辑回归模型训练
model = lm.LogisticRegression(solver='liblinear', C=1, multi_class='auto')
model.fit(train_x, train_y)
pred_y = model.predict(test_x)
print('The LogisticRegression accuracy:{}'.format(sm.accuracy_score(y_true=test_y, y_pred=pred_y)))

# 随机森林回归模型训练
model = se.RandomForestClassifier(max_depth=5, n_estimators=500, random_state=4)
model.fit(train_x, train_y)
pred_y = model.predict(test_x)
print('The RandomForest accuracy:{}'.format(sm.accuracy_score(test_y, pred_y)))

# 决策树回归模型训练
model = st.DecisionTreeClassifier(max_depth=5, random_state=4)
model.fit(train_x, train_y)
pred_y = model.predict(test_x)
print('The DecisionTree accuracy:{}'.format(sm.accuracy_score(test_y, pred_y)))

# 支持向量机SVM模型训练
model = svm.SVC(kernel='rbf', C=600, gamma=0.01)
model.fit(train_x, train_y)
pred_y = model.predict(test_x)
print('The accuracy of the SVM:{}'.format(sm.accuracy_score(test_y, pred_y)))

# 朴素贝叶斯模型训练
model = nb.GaussianNB()
model.fit(train_x, train_y)
pred_y = model.predict(test_x)
cr = sm.classification_report(test_y, pred_y)
print(cr)
print('The GaussianNB accuracy:{}'.format(sm.accuracy_score(test_y, pred_y)))