【机器学习】分类算法-逻辑回归 No.13

1、定义

逻辑分类是解决二分类问题的利器

逻辑回归公式：

2、损失函数

3、Sklearn逻辑回归API

sklearn.linear_model.LogisticRegression

4、案例：良/恶性癌症预测

数据地址：http://archive.ics.uci.edu/ml/machine-learning-databases/breast-cancer-wisconsin/

数据中列：

分析流程：

代码：

import pandas as pd
import numpy as np
from sklearn.model_selection import train_test_split
from sklearn.preprocessing import StandardScaler
from sklearn.linear_model import LogisticRegression
from sklearn.metrics import classification_report

def logistic():
    '''
    逻辑回归做二分类进行癌症预测（根据细胞的属性特征）
    :return: None
    '''
    # 构造列名
    column = ["Sample code number",
              "Clump Thickness",
              "Uniformity of Cell Size",
              "Uniformity of Cell Shape",
              "Marginal Adhesion",
              "Single Epithelial Cell Size",
              "Bare Nuclei",
              "Bland Chromatin",
              "Normal Nucleoli",
              "Mitoses",
              "Class"]
    # 读取数据
    data = pd.read_csv("http://archive.ics.uci.edu/ml/machine-learning-databases/breast-cancer-wisconsin/breast-cancer-wisconsin.data",names=column)

    # 数据缺失值处理
    data = data.replace(to_replace='?',value=np.nan)

    data = data.dropna()

    print(data)
    # 进行数据分割
    x_train, x_test, y_train, y_test = train_test_split(data[column[1:10]], data[column[10]], test_size=0.25)

    # 进行标准化处理
    std = StandardScaler()
    x_train = std.fit_transform(x_train)
    x_test = std.fit_transform(x_test)

    # 进行逻辑回归预测
    lg = LogisticRegression(C=1.0)

    lg.fit(x_train,y_train)

    y_predict = lg.predict(x_test)

    print(lg.coef_)
    print("准确率：", lg.score(x_test, y_test))
    print("召回率：", classification_report(y_test, y_predict, labels=[2,4],target_names=['良性','恶性']))

    return None


if __name__ == "__main__":
    logistic()

执行结果：

5、逻辑回归总结

应用：广告点击率预测、是否患病、金融诈骗、是否为虚假账号

优点：适合需要得到一个分类概率的场景，简单，快速

缺点：不好处理多分类的问题