逻辑回归|乳腺癌数据集

学习记录

1.

from sklearn.linear_model import LogisticRegression as LR
from sklearn.datasets import load_breast_cancer
import numpy as np
import matplotlib.pyplot as plt
from sklearn.model_selection import train_test_split
from sklearn.metrics import accuracy_score

2.

data = load_breast_cancer()
X = data.data
y = data.target

L1范式L2范式

lrl1 = LR(penalty="l1",solver = "liblinear",C = 0.5,max_iter = 1000)
lrl2 = LR(penalty="l2",solver = "liblinear",C = 0.5,max_iter = 1000)

coef_逻辑回归的重要属性，查看每个特征所对应的参数

lrl1 = lrl1.fit(X,y)
lrl1.coef_

L1会使一部分参数为0

L2范式

lrl2 = lrl2.fit(X,y)
lrl2.coef_

 画学习曲线

l1 = []
l2 = []
l1test = []
l2test = []
Xtrain,Xtest,Ytrain,Ytest = train_test_split(X,y,test_size=0.3,random_state = 420)
for i in np.linspace(0.05,1,19):
    lrl1 = LR(penalty = 'l1',solver = 'liblinear',C = i,max_iter=1000)
    lrl2 = LR(penalty = 'l2',solver = 'liblinear',C = i,max_iter=1000)
    lrl1 = lrl1.fit(Xtrain,Ytrain)
    l1.append(accuracy_score(lrl1.predict(Xtrain),Ytrain))
    l1test.append(accuracy_score(lrl1.predict(Xtest),Ytest))
    lrl2 = lrl2.fit(Xtrain,Ytrain)
    l2.append(accuracy_score(lrl2.predict(Xtrain),Ytrain))
    l2test.append(accuracy_score(lrl2.predict(Xtest),Ytest))
graph = [l1,l2,l1test,l2test]
color = ['green','black','lightgreen','gray']
label = ['L1','L2','L1test','L2test']

plt.figure(figsize=(6,6))
for i in range(len(graph)):
    plt.plot(np.linspace(0.05,1,19),graph[i],color[i],label=label[i])
plt.legend(loc=4)
plt.show()

至少在我们的乳腺癌数据集下，两种正则化的结果区别不大。但随着C的逐渐变大，正则化的强度越来越小，模型在训练集和测试集上的表现都呈上升趋势，直到C=0.8左右，训练集上的表现依然在走高，但模型在未知数据集上的表现开始下跌，这时候就是出现过拟合。默认使用l2,效果不好试试l1