HW-sklearn

最新推荐文章于 2024-08-13 19:51:34 发布

Zayn1016

最新推荐文章于 2024-08-13 19:51:34 发布

阅读量483

点赞数

本文链接：https://blog.csdn.net/Zayn1016/article/details/80722965

版权

题目：

思路：

按照解题步骤进行，1.创建数据集； 2.cross validation; 3.根据不同模型、不同参数训练数据集并打印分数

代码文件：

from sklearn import datasets, cross_validation, metrics

# creat dataset
dataset = datasets.make_classification(n_samples = 1000, n_features = 10, n_classes = 2)
X, y = dataset[0], dataset[1]
print('Generate dataset:')
print("X: \n", X)
print("y: \n", y)

kf = cross_validation.KFold(len(dataset[0]), n_folds = 10, shuffle = True)
for train_index,test_index in kf:
    X_train,y_train=X[train_index],y[train_index]
    X_test,y_test=X[test_index],y[test_index]
print("X_train: \n", X_train)
print("X_test: \n", X_test)
print("y_train: \n", y_train)
print("y_test: \n", y_test)

# GaussianNB
from sklearn.naive_bayes import GaussianNB
clf = GaussianNB()
clf.fit(X_train, y_train)
pred = clf.predict(X_test)

print("GaussianNB:")
acc = metrics.accuracy_score(y_test, pred)
print('ACU score:', acc)
f1 = metrics.f1_score(y_test, pred)
print('f1 score:', f1)
auc = metrics.roc_auc_score(y_test, pred)
print('ROC ACU score:', auc)
print('\n')

# SVC
from sklearn.svm import SVC
for C in  [1e-02, 1e-01, 1e00, 1e01, 1e02]:
    clf = SVC(C)
    clf.fit(X_train, y_train)
    pred = clf.predict(X_test)

    print("SVM for C="+str(C))
    acc = metrics.accuracy_score(y_test, pred)
    print('ACU score:', acc)
    f1 = metrics.f1_score(y_test, pred)
    print('f1 score:', f1)
    auc = metrics.roc_auc_score(y_test, pred)
    print('ROC ACU score:', auc)
    print('\n')
    
# random forest
from sklearn.ensemble import RandomForestClassifier
for n_estimators in [10, 100, 1000]:
    clf = RandomForestClassifier(n_estimators)
    clf.fit(X_train, y_train)
    pred = clf.predict(X_test)
    
    print("SVM for n_estimators="+str(n_estimators))
    acc = metrics.accuracy_score(y_test, pred)
    print('ACU score:', acc)
    f1 = metrics.f1_score(y_test, pred)
    print('f1 score:', f1)
    auc = metrics.roc_auc_score(y_test, pred)
    print('ROC ACU score:', auc)
    print('\n')

结果展示:

1.生成数据

Generate dataset:
X: 
 [[-0.8778031  -0.81990625 -0.27682605 ... -0.40727938 -0.03159566
   1.26544096]
 [ 1.56537963  0.87262797  0.41201431 ... -0.28005448 -0.55747947
  -2.00955413]
 [-0.55057975 -1.18579242 -1.11653508 ... -0.43186784  0.19633322
   1.07519348]
 ...
 [ 1.32196557  0.84996601 -1.60876452 ... -1.0545994  -0.03097829
  -1.7444495 ]
 [-1.37210395 -1.02270272 -0.5252482  ... -2.41794584 -0.57794295
   1.86950353]
 [ 0.46602468  1.14592129 -1.73982317 ... -0.94891145  1.33998618
  -0.969691  ]]
y: 
 [1 0 1 0 0 0 1 1 1 0 1 1 1 0 1 1 0 1 1 1 0 1 0 0 0 1 0 0 1 0 0 1 0 0 1 0 1
 1 1 1 1 0 1 0 1 1 0 0 1 0 1 0 0 0 0 0 1 0 0 1 1 1 0 1 1 1 0 0 1 1 1 0 0 0
 1 0 0 1 1 1 0 0 1 0 1 0 0 1 1 0 1 1 0 1 0 0 0 0 0 0 0 0 1 1 1 0 0 1 1 0 0
 0 1 0 0 0 0 0 1 1 1 0 1 1 1 0 1 0 1 1 0 0 0 0 0 1 1 1 1 0 1 1 0 1 1 0 0 1
 1 0 0 0 0 0 1 0 1 0 0 1 1 0 1 0 1 0 0 1 0 0 0 1 0 0 0 1 1 0 0 1 1 1 0 0 1
 1 1 1 0 1 1 1 0 0 0 1 1 0 0 1 1 0 1 0 0 1 0 0 0 0 1 1 0 1 1 0 1 1 1 1 0 0
 1 1 1 1 0 1 0 1 1 1 1 1 0 0 1 0 0 1 1 0 0 1 1 0 1 0 1 1 1 0 0 1 0 1 1 1 0
 1 0 1 0 1 0 1 1 1 0 0 1 1 0 0 1 0 0 1 0 0 1 1 1 1 1 0 1 1 0 0 1 1 0 0 1 1
 0 1 1 0 0 1 1 1 1 1 0 0 1 0 1 0 1 0 1 0 1 1 0 0 1 1 0 1 0 0 1 0 0 0 0 0 0
 0 1 1 1 0 0 0 0 1 0 0 0 0 1 0 1 0 1 0 1 1 0 1 0 1 0 0 0 0 0 1 1 1 1 1 1 1
 0 1 1 0 1 0 0 0 0 0 0 1 0 0 0 0 1 1 0 0 1 1 1 0 0 1 1 0 0 0 1 0 0 0 0 1 0
 0 0 1 0 1 0 0 1 1 0 0 1 0 1 0 0 1 0 1 0 1 0 1 1 1 1 1 1 1 1 1 1 0 1 0 1 0
 1 1 1 0 1 0 0 1 0 1 1 1 1 0 1 0 1 1 1 1 1 0 1 1 0 1 1 0 0 0 1 0 1 0 0 1 0
 1 0 1 1 0 1 1 1 0 1 1 0 0 1 1 1 0 0 0 1 0 0 0 1 0 1 0 1 1 0 1 0 0 1 1 0 1
 1 1 0 1 0 1 1 1 1 0 0 0 0 1 1 0 0 1 1 0 0 0 0 0 0 1 1 1 1 0 1 0 0 1 0 0 0
 1 1 1 0 0 0 1 1 1 0 1 0 1 0 1 0 1 1 0 0 0 1 1 0 0 0 0 0 0 1 1 0 0 0 1 1 0
 0 1 1 1 1 0 0 1 1 0 1 0 0 0 0 1 1 0 1 0 1 0 1 1 1 1 0 1 1 1 0 0 0 0 0 1 1
 0 0 1 0 0 0 1 0 1 0 0 0 0 1 1 1 0 1 0 1 1 1 1 0 1 0 0 1 1 0 0 1 1 0 0 0 0
 0 0 0 0 0 0 1 1 0 1 1 1 1 0 1 0 1 0 0 0 1 0 0 1 1 0 1 1 0 1 1 0 0 1 0 0 1
 1 1 0 1 1 0 0 1 1 0 1 0 0 1 0 1 1 0 1 0 0 1 1 0 0 0 1 1 0 0 1 1 0 0 1 1 0
 1 0 1 1 1 1 1 0 1 0 0 1 1 0 0 1 0 1 0 0 0 0 1 0 1 0 0 0 0 0 1 0 1 0 1 1 0
 0 0 0 1 1 0 1 1 0 1 0 1 0 0 0 1 0 1 1 1 0 1 0 0 1 0 0 1 0 1 0 0 1 1 0 1 1
 0 1 1 0 0 1 0 1 0 1 0 0 0 0 0 0 1 1 1 0 1 1 0 1 0 1 0 0 1 1 1 0 1 1 1 1 0
 0 0 0 1 0 0 0 0 1 0 1 0 0 0 0 1 1 0 1 1 0 0 1 1 1 0 1 0 0 0 0 1 0 1 1 1 1
 0 1 1 0 0 1 0 0 0 1 1 0 0 0 1 1 0 0 0 0 1 0 0 1 1 0 1 1 0 1 0 1 1 1 1 0 0
 1 1 1 1 1 1 0 0 1 0 0 0 0 1 1 0 1 1 0 1 1 1 1 1 1 1 1 0 1 0 0 1 1 1 0 0 0
 0 0 1 1 1 1 1 1 1 0 0 0 0 1 0 1 1 1 0 0 1 1 0 1 0 1 0 1 1 0 1 0 1 0 1 0 1
 0]

2.cross validation

X_train: 
 [[-0.8778031  -0.81990625 -0.27682605 ... -0.40727938 -0.03159566
   1.26544096]
 [-0.55057975 -1.18579242 -1.11653508 ... -0.43186784  0.19633322
   1.07519348]
 [-0.07539789  1.43210122  0.40485522 ... -0.54328778 -0.89279658
  -0.52110625]
 ...
 [ 0.46377264 -0.5941382   1.14695513 ...  0.82494531  0.22831932
  -0.23796167]
 [-1.37210395 -1.02270272 -0.5252482  ... -2.41794584 -0.57794295
   1.86950353]
 [ 0.46602468  1.14592129 -1.73982317 ... -0.94891145  1.33998618
  -0.969691  ]]
X_test: 
 [[ 1.56537963e+00  8.72627974e-01  4.12014314e-01  5.85881964e-01
   4.77685317e-01 -4.02770510e-01  1.83965435e+00 -2.80054476e-01
  -5.57479470e-01 -2.00955413e+00]
 [ 1.18201616e+00 -5.48627681e-01 -1.64782817e+00  1.02481074e-01
   1.28086756e-01 -2.05093255e-01  4.74704038e-01 -9.23897826e-03
   6.22315156e-01 -1.01125517e+00]
 [-9.29291486e-01  6.19642624e-01  2.62949465e-01  9.86938847e-01
  -1.94276390e+00  4.77152014e-01 -2.30606008e-01  1.73837217e+00
  -1.28982443e+00  7.16105918e-01]
 [ 1.49659908e+00 -6.37789285e-01  7.03901057e-01 -1.11296159e+00
   7.21914720e-01 -1.37869986e+00  6.44092457e-01 -1.80413975e-01
  -1.66632978e-01 -1.30422116e+00]
 [ 1.24260712e+00 -7.05116239e-01  4.03927102e-01  3.37200691e-01
   1.17132598e-01 -1.47918016e+00  4.01832796e-01 -1.97783437e-01
   2.52955233e-01 -1.00928702e+00]
 [ 1.36370682e+00  8.25782901e-01  1.93110593e+00  1.49496594e+00
  -1.21150408e+00  1.80021865e-01  1.65230512e+00  5.16925954e-01
   1.59489500e+00 -1.77814478e+00]
 [ 1.54240292e+00 -1.77720752e+00 -4.63342488e-01 -1.01355237e+00
   1.02609566e+00  1.23823005e+00 -1.84238929e-01  1.80017508e-01
  -5.26410742e-01 -8.74719814e-01]
 [ 9.01547848e-01  9.69582905e-01  1.15450327e+00  2.43435594e+00
  -1.63329890e+00 -1.32413370e+00  1.41315509e+00  8.40005869e-01
  -6.11481443e-01 -1.35311355e+00]
 [ 1.19159139e+00 -9.39441622e-01 -1.05080818e+00  2.61262834e-01
  -9.39248571e-01 -2.07837975e-01  1.85970788e-01  1.26237939e-01
  -2.02486391e+00 -8.57496142e-01]
 [-2.76771214e+00  2.17531885e+00 -4.11824671e-01  4.63832001e-01
   2.38440091e+00  1.03299412e-01 -4.37046871e-01  7.31038010e-01
   1.18787822e+00  1.99452693e+00]
 [-1.11753590e+00  6.90895163e-01  2.36094128e+00 -8.56228800e-01
  -6.15617769e-01  8.07933463e-01 -3.18413078e-01  2.53098411e-01
  -8.14233414e-01  8.83912430e-01]
 [-7.58842005e-01  1.19620368e+00  7.14953551e-01  2.86776610e-01
   2.63874274e-01  4.19267447e-01  3.34357397e-01 -1.13578097e-01
  -2.60970193e-01  2.95447636e-01]
 [ 4.12884904e-01  1.14966003e+00  1.88632795e+00 -3.14596381e-02
   3.29585444e-01 -3.25595929e-01  1.18151633e+00  2.61777352e-01
   6.74597766e-01 -9.15456808e-01]
 [-1.90878002e+00  1.49406176e+00  2.25865425e+00 -2.82428444e-02
   1.09696949e+00  3.38638001e-01 -3.06084693e-01  1.01149452e-01
   1.45081606e-01  1.37813074e+00]
 [-1.70934489e+00  1.13482877e+00 -1.27780236e+00 -1.00184032e+00
  -1.09870336e+00  1.68687937e+00 -4.27923546e-01 -9.94209207e-01
  -1.94605473e-01  1.31928310e+00]
 [-2.73632597e+00  2.25135586e+00  1.74332187e-01  2.74440002e-01
  -9.12369377e-02 -1.51285120e+00 -3.55831487e-01 -6.41841906e-01
  -1.05123760e+00  1.92969704e+00]
 [-2.57005085e+00  1.88479970e+00 -3.32014835e-01 -1.79294362e-01
  -1.63317568e+00 -1.38838553e+00 -5.08187952e-01  1.08505713e-01
   1.50564419e+00  1.90873984e+00]
 [ 2.00894271e-01  9.14462464e-01  6.37826595e-01 -2.78334913e-02
  -1.67802727e-01 -6.29635273e-01  8.43766875e-01 -9.68152912e-02
  -1.10992985e-01 -5.94262901e-01]
 [ 3.31287546e-01  1.00069852e+00  1.94946748e+00 -3.80549649e-01
  -7.62845610e-02  1.10681330e+00  1.00726577e+00  5.86529198e-01
   1.86684480e-01 -7.67333780e-01]
 [-1.69750558e+00  1.37691762e+00  1.51101597e+00  1.56947159e+00
  -1.85769871e+00 -1.94517092e+00 -2.35685625e-01  8.22087674e-01
  -6.95285680e-01  1.20537669e+00]
 [-9.77125689e-01 -6.10089292e-01  6.08167956e-01  1.09110144e+00
  -1.17242906e+00 -3.06885807e-02 -1.19784444e+00 -4.19658425e-01
   7.99364177e-01  1.28179118e+00]
 [-8.92550946e-01 -1.52325266e+00 -2.38878938e+00 -2.44968465e-01
  -1.16360603e+00 -1.13989383e+00 -1.82564655e+00  1.31019443e+00
  -4.54732513e-01  1.57574261e+00]
 [-1.09963439e+00 -7.39780187e-01 -7.19881768e-02 -9.35486162e-01
  -7.42325628e-01 -3.82003906e-01 -1.38831183e+00 -3.49479154e-01
  -1.45263330e+00  1.46479714e+00]
 [-3.98038251e-01 -7.21380303e-01 -3.76534588e-02 -2.14632285e+00
  -8.56575756e-01  2.21175372e-02 -8.46020453e-01  3.05587440e-01
   5.76582363e-01  7.20348534e-01]
 [-9.04240007e-02 -1.33898441e+00  4.50276935e-02 -1.78263237e-01
   1.22326402e+00 -1.04328933e+00 -1.08204349e+00 -1.03420277e+00
  -3.01154763e+00  6.56202547e-01]
 [ 3.72660518e-01 -1.57959667e+00 -3.02385877e+00 -7.74932979e-01
   5.55352292e-01  1.76197117e+00 -9.15507607e-01 -1.38286867e+00
   9.66146035e-01  2.70779296e-01]
 [ 8.66715736e-01  9.70321556e-01  2.89234452e-02  6.98492193e-01
   1.36401153e+00 -8.08660400e-01  1.38748307e+00  1.09211168e-01
  -3.75081227e-02 -1.31684646e+00]
 [-6.53586720e-01  5.22023840e-01 -2.38919492e-01 -3.27638820e-01
  -2.96911585e-01 -1.87469122e+00 -9.69001527e-02  5.41373835e-01
  -1.19097074e-01  4.67510230e-01]
 [-2.13288131e-01 -7.83845805e-01 -5.46436935e-01 -2.88452768e-01
  -1.72060867e+00  1.32635575e+00 -7.54190877e-01 -1.66609194e-01
  -4.52046363e-02  5.52528151e-01]
 [ 6.86959058e-01 -7.23540063e-01  2.59624405e-01  1.19254941e-01
  -2.61135317e-01  2.48490576e-01 -3.05661216e-02 -3.55110105e-01
   1.45823733e+00 -4.18086373e-01]
 [-1.52144030e+00  1.15739761e+00 -7.44380279e-01 -8.97938661e-02
   1.42596408e+00  8.26166272e-01 -2.69326075e-01  5.02539055e-01
   3.37994472e-01  1.11250720e+00]
 [ 1.11323917e+00  7.16954178e-01  1.62805103e+00 -4.66677427e-01
  -1.34249678e+00 -1.35871258e+00  1.38127230e+00 -7.74211834e-01
  -9.78807017e-01 -1.46951556e+00]
 [-1.34286406e+00 -7.53684405e-01  1.23295299e-02 -1.00846045e+00
   2.26209123e+00 -6.41275596e-01 -1.58201221e+00  7.63521970e-01
   7.99361225e-01  1.72603724e+00]
 [ 8.93239966e-01 -9.10460467e-01 -7.79012011e-01  1.17566901e+00
  -9.05899902e-01  1.75880892e+00 -1.67657093e-02 -1.44815678e+00
   1.04590050e+00 -5.56349331e-01]
 [-1.95223319e+00 -2.51376966e-01  7.48972745e-01  3.78363031e-01
  -9.70276511e-02 -8.69432985e-01 -1.66054324e+00  1.02504173e+00
   6.46975179e-01  2.15537955e+00]
 [-7.57103389e-01  4.16925096e-01 -1.46653746e+00  1.48983603e+00
   1.03268199e+00 -1.80889469e-01 -2.54442595e-01  1.76965571e+00
   1.41757563e+00  6.20264867e-01]
 [-2.09983022e+00  1.68860416e+00 -9.13276649e-01  4.33079002e-01
   1.06344930e+00 -1.61267050e+00 -3.02643409e-01 -3.99813282e-02
  -4.03702030e-01  1.49720532e+00]
 [ 2.71204576e-01 -1.04666199e+00  1.01095846e+00 -5.32760458e-01
  -8.16336904e-01 -1.71340166e+00 -5.88346855e-01 -2.25366999e-01
   7.74137263e-01  1.53931480e-01]
 [-1.57809710e-01 -1.40972916e+00  8.44200895e-01 -1.83894851e+00
   8.54107286e-01 -5.78051263e-01 -1.18636184e+00  2.47742186e-01
   2.89720094e-01  7.56616737e-01]
 [ 1.29712788e+00  1.06599428e+00 -9.76573947e-01  5.78586528e-01
  -7.15447069e-01 -5.40627972e-01  1.78406611e+00  9.48463516e-02
   6.19317920e-01 -1.80891835e+00]
 [-6.75493770e-01  4.70222709e-01 -1.21121896e+00 -7.05535868e-01
   6.88531618e-01  3.57012672e-01 -1.52624361e-01 -1.00737437e-01
   1.56663454e+00  5.12227508e-01]
 [-9.99047892e-02 -1.21142272e+00  9.95780968e-01 -7.93903528e-02
   1.92051892e+00  8.47104439e-01 -9.92587100e-01 -9.30750416e-01
   1.72986945e+00  6.12689347e-01]
 [ 6.53530911e-01 -6.85096026e-01 -3.88187426e-01 -6.19640851e-02
  -5.93704578e-02 -7.10824862e-01 -2.66284151e-02 -2.96321084e+00
   1.14014957e+00 -3.99098180e-01]
 [-1.31960255e-01  1.35861661e+00 -1.04265386e+00  6.19971882e-01
   2.87581085e+00 -9.23198013e-01  9.29436845e-01 -4.67178847e-01
   7.13404778e-01 -4.30909057e-01]
 [ 1.09003809e+00 -1.27231290e-01  8.59080808e-01 -7.24766528e-01
   3.13038042e-01 -7.47002446e-01  7.24539930e-01 -8.76145586e-01
   1.65090851e+00 -1.09130309e+00]
 [-1.77828335e-01  9.25432190e-01 -1.38234557e+00  2.61803217e-01
  -1.47246679e+00  1.03438019e+00  5.66865274e-01 -6.08848208e-01
   2.11349410e+00 -2.01169774e-01]
 [-9.52698448e-01 -3.74958596e-01  1.35268149e+00 -5.07765593e-01
  -7.06290560e-01  3.98564240e-01 -1.00139587e+00  1.01589080e+00
   6.13932829e-01  1.15758294e+00]
 [ 1.26244658e+00  2.15869153e-01 -1.50673857e+00  3.88961428e-01
   1.46132786e+00  1.22719377e+00  1.11419039e+00 -1.38171200e+00
  -1.31104806e+00 -1.41616099e+00]
 [ 1.26270070e+00 -1.63265062e-01  1.03842759e-01 -1.80195183e+00
  -1.47560389e+00 -1.30854514e-01  8.27282093e-01 -6.92505093e-01
  -5.91529735e-01 -1.25750970e+00]
 [-1.00449148e+00  6.97743084e-01 -5.72385762e-01 -3.18116445e-01
  -4.97908155e-02  5.34290419e-01 -2.28095984e-01 -4.07881846e-01
   8.98115733e-01  7.62335713e-01]
 [ 1.10259685e+00  8.13863028e-01 -5.12169726e-01  7.24844207e-01
  -8.41756481e-01 -1.15905902e-01  1.44664209e+00 -1.58563915e-01
   1.62444901e+00 -1.49896059e+00]
 [-7.41291124e-01 -1.19661393e+00  2.15719936e-01  2.11294243e-01
   1.15216485e+00  1.69791911e-01 -1.46438837e+00 -9.52974590e-02
  -2.05648340e+00  1.27999272e+00]
 [-2.26603305e+00  1.64874046e+00 -8.68638317e-02 -1.10685109e+00
  -2.49114464e-01  1.31786336e+00 -4.57994258e-01 -4.91726670e-01
   2.14873869e-01  1.68844183e+00]
 [-1.18258118e+00 -6.90031370e-01 -1.77947455e-01  4.78280607e-01
   1.04514687e+00 -5.63935682e-02 -1.41310506e+00 -8.82055543e-01
  -9.53191514e-01  1.53104563e+00]
 [ 3.15776670e-01 -1.06672589e+00  8.76003269e-01 -1.77171449e+00
   8.90140983e-01  1.06621832e-01 -5.69973904e-01  3.02549229e-01
  -1.67817779e+00  1.15536958e-01]
 [-1.77895989e+00  1.30529970e+00  6.10373031e-01 -3.00997182e-01
  -2.61725446e-01 -6.06393325e-01 -3.51259972e-01 -1.04650279e+00
   1.11334598e+00  1.32093012e+00]
 [ 1.37668741e+00 -1.05788364e+00  2.90125434e-02 -4.41702267e-01
  -2.07677784e-01 -9.46910877e-01  2.35672596e-01  1.24801501e+00
  -8.19493573e-01 -1.00221660e+00]
 [ 1.10606853e-01  1.14369968e+00  1.02942422e+00  3.26273747e-01
  -7.24501980e-01  5.24475241e-02  9.49363285e-01  4.98542948e-01
   1.33783972e+00 -5.95540597e-01]
 [-5.59471575e-01 -8.34487874e-01 -9.22648367e-01  1.73064834e-01
  -1.09607406e-01  1.68658140e+00 -1.05324346e+00  8.48275353e-02
   2.46550503e+00  9.37277610e-01]
 [ 2.20090749e+00  1.02132773e+00 -2.47113066e-01 -1.32091249e+00
  -6.80985374e-01 -9.61737145e-02  2.43086070e+00 -1.38979696e+00
   1.14757126e-01 -2.73924196e+00]
 [ 2.58916721e-02  1.16448489e+00 -2.97900547e-01  1.93732732e-01
   7.93213688e-01  7.94851217e-01  9.01305589e-01 -2.56165973e+00
  -1.26751090e+00 -5.15294736e-01]
 [-2.68727655e+00  2.05805124e+00 -1.04568385e+00  9.07648040e-01
  -1.03007039e+00 -2.42583678e-01 -4.65273425e-01  2.09663953e+00
   1.16664161e+00  1.95921664e+00]
 [-2.68342846e+00  2.08941253e+00 -1.98062192e-01  7.21310246e-01
   3.52363403e-01 -1.58773101e+00 -4.38627141e-01  1.14253589e+00
  -4.81614352e-01  1.94203039e+00]
 [-3.02794187e-01 -1.02177373e+00  1.67139952e+00 -8.84516648e-01
   1.34099338e-01 -2.48579496e-01 -1.00176721e+00 -5.29867686e-01
   2.96625663e-01  7.46247213e-01]
 [ 7.86538875e-02 -1.61254675e+00 -1.82914362e+00  5.11239169e-01
   9.51445795e-01 -1.14749132e+00 -1.16186961e+00  1.35502983e+00
  -4.60301358e-01  5.93322843e-01]
 [ 6.70720502e-01 -5.94685589e-01  5.65199355e-01  1.24649889e-03
   6.33618516e-01 -1.65395499e+00  5.47800953e-02 -1.75149328e+00
  -2.28268229e-01 -4.55045223e-01]
 [-1.48099874e+00  1.16411805e+00  2.32319963e-01 -1.29960259e+00
  -1.78138021e+00  5.06148744e-01 -2.33781283e-01  1.43889205e+00
   1.03248916e+00  1.06722315e+00]
 [ 1.54156781e-01 -1.58776393e-01 -7.42362297e-01  8.91788298e-02
   1.05689337e+00  1.94762031e+00 -4.14115289e-03  9.68936586e-01
  -1.29233306e-02 -9.53250176e-02]
 [ 1.39345872e+00 -1.55993828e+00 -2.80259726e-02 -2.24147943e-01
  -8.99752863e-02  9.95254346e-01 -1.31878531e-01 -8.60465993e-01
  -1.24720024e-01 -8.09386357e-01]
 [ 1.06282295e+00  6.63274280e-01  2.25198794e-01  5.75853786e-01
   1.03086251e+00 -3.03516469e-01  1.30265571e+00  3.69245587e-01
   1.44898687e+00 -1.39407370e+00]
 [-1.22990922e+00  1.32917330e+00  1.65359005e-01 -2.30426705e+00
  -4.92956096e-02 -6.19161714e-01  8.02974320e-02  2.15248841e+00
  -1.95020304e-01  7.34372964e-01]
 [-7.68962792e-02  1.18394955e+00  3.64644626e-01  2.78986807e-01
  -3.75736939e-01  1.63576197e+00  8.38637662e-01 -9.62652376e-01
   1.76022932e+00 -4.15517393e-01]
 [ 1.62480514e+00 -2.81758906e+00 -1.54466923e+00  1.37668092e+00
  -8.25244887e-01  1.22292889e+00 -9.10013192e-01 -1.29741697e+00
  -4.94180533e-01 -5.25162192e-01]
 [ 1.69875901e+00 -1.85558671e+00 -1.05549411e+00 -2.20183485e+00
   2.49756183e-02 -1.04813993e+00 -1.25842982e-01  2.95587963e-01
   3.49843721e-01 -1.00605364e+00]
 [ 9.50729269e-01  6.79903804e-01  1.11190458e+00 -6.86222567e-01
  -6.22518018e-01 -4.57673181e-01  1.23083291e+00  5.47148001e-01
  -1.71138410e+00 -1.28333617e+00]
 [ 7.12405093e-02  9.10376476e-01  5.83720322e-01 -1.87781137e+00
  -7.21289285e-01  1.62412656e+00  7.43033097e-01 -1.78234734e+00
  -9.12142361e-02 -4.56402650e-01]
 [ 9.77646463e-01  1.25105359e+00  1.21409644e+00 -2.22335947e-03
   1.25197269e+00  8.93529784e-01  1.68360733e+00 -1.28018267e-01
   1.14150420e+00 -1.55100506e+00]
 [-2.86521229e+00  2.18829286e+00  3.41999664e-01  1.81189985e-01
   1.82660730e+00  1.76853454e+00 -5.00647706e-01 -3.61973028e-01
  -7.42456165e-01  2.09147226e+00]
 [-2.56819548e+00  2.03235273e+00  8.24988732e-01 -8.70575229e-01
   5.69766694e-01  2.00455047e-01 -3.95056056e-01 -1.24820526e+00
  -1.73768326e-01  1.84494311e+00]
 [-1.37943681e+00  9.77312601e-01 -6.28105817e-01 -7.68559924e-01
   2.90449740e+00  2.17130442e+00 -2.98755601e-01 -4.28167343e-01
  -1.14112404e+00  1.03887592e+00]
 [-2.87357086e-01 -8.36247021e-01  1.30083411e+00 -2.69523738e-01
  -5.09562531e-01 -5.26222860e-01 -8.49651589e-01 -1.55103760e+00
  -2.90471258e-01  6.52271433e-01]
 [ 1.07091235e+00  6.81523910e-01  4.33883637e-01 -1.93673287e-01
  -9.33567650e-02  3.89051299e-01  1.32256722e+00 -5.52694863e-02
   9.93433358e-01 -1.41021780e+00]
 [ 1.58207269e+00 -1.15011963e+00 -3.44175071e-01 -1.04866555e+00
  -2.21818044e-01  2.90629190e-01  3.20498379e-01 -6.54907125e-02
   2.50159605e+00 -1.17922705e+00]
 [-2.66561679e+00  2.17343193e+00 -1.08659246e+00 -1.13212096e-03
   3.63494810e-01 -1.41532150e+00 -3.61589772e-01 -2.06492517e-01
   1.66457864e+00  1.88810899e+00]
 [ 3.12026746e-01 -1.65419017e+00  5.10377154e-01  4.34661123e-01
  -1.30932661e+00 -1.36265860e+00 -1.01765568e+00 -1.85412567e+00
  -7.21763237e-01  3.65716615e-01]
 [-3.27814427e-01  1.19263350e+00 -5.07402261e-01 -1.94437404e-01
   1.26388107e+00 -1.38106306e+00  6.56252141e-01 -2.02506840e+00
  -8.76671871e-01 -1.55671796e-01]
 [-7.94901615e-01 -8.93038719e-01  2.69031776e-01  2.49696957e-01
   2.95527881e-01  4.22928613e-02 -1.27487880e+00 -1.38007397e+00
  -6.22313915e-02  1.20904155e+00]
 [-2.35704966e+00  1.79319621e+00 -4.42210313e-01  2.22040220e+00
   1.30457062e+00  2.32571772e-01 -4.17147821e-01  1.37034574e-01
   9.43374940e-01  1.72346691e+00]
 [-1.61952724e+00  1.20361220e+00 -9.55769213e-01 -1.82252224e+00
   6.61593851e-01  1.56981413e-01 -3.08197363e-01 -8.70818402e-01
  -6.18264810e-01  1.19613556e+00]
 [ 9.74881856e-01  9.19020730e-01 -6.45679757e-01 -6.31400060e-01
  -1.46651339e+00 -6.61160979e-03  1.43009322e+00 -1.09571331e+00
  -4.98630213e-01 -1.40892687e+00]
 [ 1.06114585e+00  1.50872291e-01 -4.93455643e-01  4.35617515e-01
  -1.15108432e+00 -3.53137831e-01  9.13375911e-01 -1.93955632e-01
   2.76989420e+00 -1.17753384e+00]
 [-4.02799870e-01 -1.07597647e+00 -1.53672775e-01  3.84458507e-01
  -2.97093483e-01  1.91697888e+00 -1.11812455e+00 -1.06721010e+00
   1.23307389e+00  8.73981407e-01]
 [ 1.66072169e+00 -8.81819160e-01  5.51855617e-01  1.86031641e+00
   1.31491114e+00 -5.70627988e-01  5.82898106e-01  1.32448704e+00
   2.07650440e+00 -1.37427625e+00]
 [ 1.62425267e+00 -1.27381257e+00  6.79617670e-01 -1.71617801e+00
  -1.03371057e+00 -7.56445837e-01  2.58596706e-01  3.23010847e-01
  -1.09526561e+00 -1.17167244e+00]
 [-3.68244081e-01 -1.13475432e+00 -8.61703334e-01 -1.04834981e+00
   9.39511720e-02 -1.53367882e+00 -1.13661086e+00  2.05098868e+00
   4.14793521e+00  8.62332230e-01]
 [ 5.97247511e-01  1.15674705e+00 -2.13294362e+00 -1.70574427e+00
  -1.23690055e+00  1.61789123e+00  1.32572278e+00  3.48194475e-01
  -8.51677222e-01 -1.11202395e+00]
 [ 1.49707538e+00 -2.30220239e+00  7.74806480e-01  8.98476119e-01
   1.31442803e+00 -5.55029164e-01 -6.15926964e-01  3.84852069e-02
  -1.48210824e+00 -6.07064815e-01]
 [-1.03704005e+00  7.62580757e-01 -8.39335852e-01 -2.11554867e-01
  -1.05190691e+00  1.15935315e+00 -2.03509286e-01  1.49258273e+00
   1.88732230e+00  7.69337101e-01]
 [ 1.16561327e+00 -1.59789440e+00 -9.87303223e-01 -2.13977812e+00
  -1.07538608e+00  1.18836820e+00 -3.32206690e-01  1.65937764e-01
  -3.19011895e-01 -5.54219390e-01]
 [ 1.32196557e+00  8.49966014e-01 -1.60876452e+00  3.11568025e-01
  -4.90741666e-01  8.25090414e-01  1.63918330e+00 -1.05459940e+00
  -3.09782874e-02 -1.74444950e+00]]
y_train: 
 [1 1 0 0 0 1 1 1 1 1 1 0 1 0 1 1 1 0 1 0 0 1 0 0 1 0 1 0 1 1 1 1 1 1 0 1 0
 1 1 0 0 1 0 1 0 0 0 0 1 0 1 1 1 0 1 1 0 0 1 1 1 0 0 0 1 0 0 1 1 1 0 0 1 0
 1 0 0 1 1 0 1 1 0 1 0 0 0 0 0 0 0 0 1 1 0 0 1 1 0 0 0 1 0 0 0 0 1 1 1 0 1
 1 1 0 1 0 1 1 0 0 0 0 0 1 1 1 1 0 1 1 0 1 1 0 1 1 0 0 0 0 0 1 0 1 0 0 1 1
 0 1 0 1 0 0 1 0 0 0 0 0 0 1 0 0 1 1 0 0 1 1 1 0 1 1 1 0 0 0 1 1 0 1 1 0 1
 0 0 1 0 0 0 1 1 0 1 1 0 1 1 1 1 0 1 1 1 0 1 0 1 1 1 1 1 0 0 0 0 1 0 0 1 1
 0 1 0 1 1 1 0 0 0 1 1 0 1 0 1 0 1 0 1 1 1 0 0 1 1 0 0 1 0 0 0 0 1 1 1 1 1
 1 1 0 0 1 1 0 0 1 1 0 1 1 0 0 1 1 1 1 0 0 1 0 1 0 1 0 1 0 1 0 0 1 1 0 1 0
 0 1 0 0 0 0 0 0 0 1 0 0 0 1 0 0 0 0 1 0 1 0 1 0 1 1 0 1 0 1 0 0 0 0 0 1 1
 1 1 1 1 1 0 1 1 0 0 0 0 0 0 0 1 0 0 0 0 1 1 0 0 1 0 0 1 0 0 0 1 0 0 0 1 0
 0 0 1 0 0 0 1 0 0 1 0 1 0 0 1 0 1 1 0 1 1 1 1 1 1 1 1 0 1 0 1 0 1 1 0 1 0
 0 1 0 1 1 1 1 1 0 1 1 1 1 1 0 1 1 0 1 1 0 0 0 1 1 0 0 1 0 1 0 1 1 0 1 1 1
 0 1 1 0 0 1 1 1 0 0 0 1 0 0 1 0 1 0 1 1 0 1 0 0 1 0 1 1 1 0 1 0 1 1 1 1 0
 0 0 0 1 1 0 0 1 1 0 0 0 0 0 0 1 1 1 1 0 1 0 1 0 0 0 1 1 1 0 0 1 1 0 1 0 1
 1 0 1 1 0 0 0 1 0 0 0 0 0 0 1 0 0 0 1 1 0 0 1 1 1 0 0 1 1 0 1 0 0 0 0 1 1
 0 1 0 1 0 1 1 1 0 1 1 1 0 0 0 0 0 1 1 0 0 0 0 1 0 1 0 0 0 1 1 1 0 1 0 1 1
 1 1 0 1 0 0 1 1 0 0 1 0 0 0 0 0 0 0 0 0 1 1 0 1 1 1 1 0 1 0 1 0 0 0 1 0 0
 1 1 1 1 0 1 1 0 0 1 0 0 1 1 0 1 1 0 0 1 1 0 0 0 1 0 1 0 1 0 0 0 0 0 0 0 1
 1 0 1 1 0 1 0 1 1 1 1 1 0 1 0 0 1 1 0 0 1 0 1 0 0 0 1 0 1 0 0 0 1 1 0 1 1
 0 0 1 1 0 1 1 0 1 0 1 0 0 1 0 1 1 1 1 0 0 1 0 0 1 0 1 0 0 1 0 0 1 0 1 0 1
 0 1 0 0 0 0 0 1 1 1 0 1 0 1 0 1 0 0 1 1 1 0 1 1 1 0 0 0 1 0 0 0 0 1 0 1 0
 0 0 0 1 0 1 1 0 0 1 1 0 1 0 0 0 0 1 0 1 1 1 1 0 1 1 0 0 0 0 0 1 1 0 0 0 1
 1 0 0 0 1 0 1 1 0 1 0 1 0 1 1 1 1 0 1 1 1 1 1 1 0 1 0 0 0 0 1 1 0 1 1 0 1
 1 1 1 1 1 1 1 0 1 0 0 1 1 0 0 0 0 1 1 1 1 1 1 1 0 0 0 0 1 0 1 1 1 0 0 1 1
 1 0 1 0 1 1 0 1 0 1 1 0]
y_test: 
 [0 0 1 0 0 0 0 0 0 1 1 0 0 1 1 1 1 0 0 0 1 1 1 1 1 1 0 1 1 1 1 0 1 1 1 1 0
 1 1 0 1 1 1 0 0 0 1 0 0 1 0 1 1 1 1 1 0 0 1 0 0 1 1 1 1 1 1 1 0 0 0 0 0 0
 0 0 0 1 1 1 1 0 0 1 1 0 1 1 1 0 0 1 0 0 1 0 0 1 0 0]

3.模型评测

GaussianNB:
ACU score: 0.91
f1 score: 0.9142857142857143
ROC ACU score: 0.9102769971898835

SVM for C=0.01
ACU score: 0.91
f1 score: 0.9142857142857143
ROC ACU score: 0.9102769971898835


SVM for C=0.1
ACU score: 0.91
f1 score: 0.9142857142857143
ROC ACU score: 0.9102769971898835


SVM for C=1.0
ACU score: 0.95
f1 score: 0.9532710280373832
ROC ACU score: 0.9492171818546769


SVM for C=10.0
ACU score: 0.96
f1 score: 0.9629629629629629
ROC ACU score: 0.9586511441188278


SVM for C=100.0
ACU score: 0.94
f1 score: 0.9454545454545454
ROC ACU score: 0.9373745483741469

Random Forest for n_estimators=10
ACU score: 0.97
f1 score: 0.9724770642201834
ROC ACU score: 0.9680851063829787


Random Forest for n_estimators=100
ACU score: 0.98
f1 score: 0.9814814814814815
ROC ACU score: 0.9787234042553192


Random Forest for n_estimators=1000
ACU score: 0.98
f1 score: 0.9814814814814815
ROC ACU score: 0.9787234042553192

总结：

1. 对于SVM，随着C的取值的不断变大，模型得分先变高再变低，可见C的取值会影响到模型的准确性；

2. 对于Random Forest，n_estimator较大的取值增加了模型得分，但当取值足够大时，收益很小，而训练的时间成本增加许多；

3. 总体而言，三者的准确度：Random Rorest > SVM > GaussianNB，而对于训练模型的时间，顺序相反。