决策树及随机森林

PURE-li

已于 2023-02-09 15:34:00 修改

阅读量218

点赞数

文章标签：决策树随机森林 sklearn python

于 2023-02-09 04:28:03 首次发布

本文链接：https://blog.csdn.net/lichengxiang000/article/details/128946175

版权

一。认识决策树

决策树思想的来源非常朴素，程序设计中的条件分支结构就是if-then结构，最早的决策树就是利用这类结构分割数据的一种分类学习方法

二。决策树的划分依据之一-信息增益

注：𝐶𝑘表示C_k 表示属于某个类别的样本数

三。常见决策树使用的算法

•ID3

信息增益最大的准则

•C4.5

信息增益比最大的准则

•CART

回归树: 平方误差最小

分类树: 基尼系数最小的准则在sklearn中可以选择划分的原则

四。决策树案例

•class sklearn.tree.DecisionTreeClassifier(criterion=’gini’, max_depth=None,random_state=None) •决策树分类器

•criterion

默认是’gini’系数，也可以选择信息增益的熵’entropy’

•max_depth

树的深度大小

random_state

随机数种子

•decision_path

返回决策树的路径

import pandas as pd
from sklearn.feature_extraction import DictVectorizer#特征抽取
from sklearn.model_selection import train_test_split#数据分割
from sklearn.tree import DecisionTreeClassifier,export_graphviz#决策树
from sklearn.ensemble import  RandomForestClassifier#随机森林
from sklearn.model_selection import GridSearchCV#网格搜索

def decision():
    titan=pd.read_csv("./titan.csv")
    x=titan[["Pclass","Age","Sex"]]
    y=titan["Survived"]
    print(x)
    x["Age"].fillna(x["Age"].mean(),inplace=True)
    x_train,x_test,y_train,y_test=train_test_split(x,y,test_size=0.25)#数据分割
    dict=DictVectorizer(sparse=False)#特征抽取的实例化
    print("*******************************")
    print(x_train)
    print("*******************************")
    print(x_train.to_dict(orient="records"))
    print("*******************************")
    x_train=dict.fit_transform(x_train.to_dict(orient="records"))#对train数据进行字典化之后再输入dict并转换
    print(x_train)
    print("*******************************")
    print(dict.get_feature_names())
    x_test=dict.transform(x_test.to_dict(orient="records"))#对test数据进行字典化之后再输入dict并转换
    print(x_train)

    # dec=DecisionTreeClassifier(max_depth=3)#对决策树实例化
    # dec.fit(x_train,y_train)#输入train数据
    # print("预测的准确率：",dec.score(x_test,y_test))
    # export_graphviz(dec,out_file="./tree.dot",feature_names=['Age', 'Pclass', 'Sex=female', 'Sex=male'])#导出树的dot文件

    rf=RandomForestClassifier()#对随机森林实例化
    param={"n_estimators":[120,200,300,500,800,1200],"max_depth":[5,8,15,25,30]}#一共有三十次的组合
    gc=GridSearchCV(rf,param_grid=param,cv=2)#对网格搜索实例化
    gc.fit(x_train,y_train)#输入train数据
    print("准确率为：",gc.score(x_test,y_test))
    print("查看选择的参数模型：",gc.best_params_)

    return None
if __name__=="__main__":
    decision()

/Users/lichengxiang/opt/anaconda3/bin/python /Users/lichengxiang/Desktop/python/机器学习/决策树案例.py 
     Pclass   Age     Sex
0         3  22.0    male
1         1  38.0  female
2         3  26.0  female
3         1  35.0  female
4         3  35.0    male
..      ...   ...     ...
886       2  27.0    male
887       1  19.0  female
888       3   NaN  female
889       1  26.0    male
890       3  32.0    male

[891 rows x 3 columns]
*******************************
     Pclass   Age     Sex
857       1  51.0    male
299       1  50.0  female
724       1  27.0    male
14        3  14.0  female
446       2  13.0  female
..      ...   ...     ...
620       3  27.0    male
499       3  24.0    male
261       3   3.0    male
177       1  50.0  female
332       1  38.0    male

[668 rows x 3 columns]
*******************************
[{'Pclass': 1, 'Age': 51.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 50.0, 'Sex': 'female'}, {'Pclass': 1, 'Age': 27.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 14.0, 'Sex': 'female'}, {'Pclass': 2, 'Age': 13.0, 'Sex': 'female'}, {'Pclass': 2, 'Age': 5.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 30.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 32.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 10.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 3, 'Age': 24.5, 'Sex': 'male'}, {'Pclass': 3, 'Age': 22.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 18.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 19.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 21.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 50.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 35.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 30.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 35.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 19.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 62.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 3, 'Age': 40.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 29.69911764705882, 'Sex': 'female'}, {'Pclass': 3, 'Age': 26.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 31.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 30.0, 'Sex': 'female'}, {'Pclass': 2, 'Age': 29.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 28.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 3, 'Age': 21.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'female'}, {'Pclass': 3, 'Age': 47.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 4.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 9.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 24.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 1, 'Age': 24.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 74.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 36.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'female'}, {'Pclass': 1, 'Age': 47.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 20.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 1.0, 'Sex': 'female'}, {'Pclass': 2, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 1, 'Age': 33.0, 'Sex': 'female'}, {'Pclass': 1, 'Age': 54.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 33.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 16.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'female'}, {'Pclass': 1, 'Age': 80.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 24.0, 'Sex': 'female'}, {'Pclass': 2, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 21.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 3, 'Age': 9.0, 'Sex': 'female'}, {'Pclass': 1, 'Age': 44.0, 'Sex': 'female'}, {'Pclass': 1, 'Age': 36.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 36.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 3, 'Age': 4.0, 'Sex': 'female'}, {'Pclass': 2, 'Age': 28.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 37.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 3, 'Age': 39.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 29.69911764705882, 'Sex': 'female'}, {'Pclass': 3, 'Age': 42.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 42.0, 'Sex': 'female'}, {'Pclass': 2, 'Age': 29.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 20.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 39.0, 'Sex': 'female'}, {'Pclass': 1, 'Age': 29.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 36.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 26.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 36.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 20.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 27.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 2.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 18.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 21.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 30.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 3, 'Age': 28.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 27.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 2, 'Age': 19.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 32.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 25.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 46.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 58.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 15.0, 'Sex': 'female'}, {'Pclass': 2, 'Age': 34.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 42.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 22.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 30.0, 'Sex': 'female'}, {'Pclass': 2, 'Age': 24.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 22.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 3, 'Age': 36.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 48.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 36.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 49.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 18.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 30.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 39.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 30.5, 'Sex': 'female'}, {'Pclass': 3, 'Age': 25.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 2.0, 'Sex': 'female'}, {'Pclass': 1, 'Age': 30.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 16.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 9.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 44.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 27.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'female'}, {'Pclass': 3, 'Age': 22.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 32.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 55.5, 'Sex': 'male'}, {'Pclass': 3, 'Age': 22.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 24.0, 'Sex': 'female'}, {'Pclass': 1, 'Age': 28.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 2, 'Age': 29.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 2, 'Age': 29.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 1, 'Age': 28.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 36.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 39.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 4.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'female'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 3, 'Age': 28.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 1, 'Age': 52.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 30.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 30.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 26.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 38.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 35.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'female'}, {'Pclass': 1, 'Age': 38.0, 'Sex': 'female'}, {'Pclass': 2, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 3, 'Age': 22.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 35.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 1, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 1, 'Age': 38.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 28.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 29.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 28.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 25.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 43.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 29.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 28.0, 'Sex': 'female'}, {'Pclass': 2, 'Age': 60.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 35.0, 'Sex': 'female'}, {'Pclass': 1, 'Age': 47.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 34.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 23.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 2, 'Age': 14.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 1, 'Age': 54.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 24.0, 'Sex': 'female'}, {'Pclass': 1, 'Age': 42.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 42.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 22.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 70.5, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 2, 'Age': 32.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 12.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 32.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 15.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 3, 'Age': 43.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 1, 'Age': 56.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 3, 'Age': 23.5, 'Sex': 'male'}, {'Pclass': 2, 'Age': 52.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 62.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 9.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 3, 'Age': 18.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 25.0, 'Sex': 'female'}, {'Pclass': 2, 'Age': 32.5, 'Sex': 'female'}, {'Pclass': 1, 'Age': 51.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 28.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 16.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 61.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 35.0, 'Sex': 'female'}, {'Pclass': 1, 'Age': 11.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 37.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 31.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 26.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 2.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 14.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 27.0, 'Sex': 'female'}, {'Pclass': 2, 'Age': 19.0, 'Sex': 'female'}, {'Pclass': 1, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 3, 'Age': 22.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 48.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 3, 'Age': 22.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 33.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 29.69911764705882, 'Sex': 'female'}, {'Pclass': 3, 'Age': 47.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 19.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 56.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 65.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 49.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'female'}, {'Pclass': 1, 'Age': 21.0, 'Sex': 'female'}, {'Pclass': 1, 'Age': 53.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 32.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 9.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 4.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 21.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 2.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 59.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 44.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 3, 'Age': 51.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 30.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 2.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 20.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'female'}, {'Pclass': 3, 'Age': 39.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 3, 'Age': 19.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 42.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 16.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 30.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 26.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'female'}, {'Pclass': 1, 'Age': 45.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 36.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 40.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 41.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 34.0, 'Sex': 'female'}, {'Pclass': 1, 'Age': 44.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 50.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 19.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 55.0, 'Sex': 'female'}, {'Pclass': 1, 'Age': 27.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 24.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 3, 'Age': 21.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 4.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 23.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 26.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 41.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 45.5, 'Sex': 'male'}, {'Pclass': 3, 'Age': 19.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 1, 'Age': 54.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 1, 'Age': 2.0, 'Sex': 'female'}, {'Pclass': 2, 'Age': 27.0, 'Sex': 'female'}, {'Pclass': 2, 'Age': 40.0, 'Sex': 'female'}, {'Pclass': 2, 'Age': 3.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 50.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 9.0, 'Sex': 'female'}, {'Pclass': 2, 'Age': 28.0, 'Sex': 'female'}, {'Pclass': 1, 'Age': 61.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 47.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 20.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 27.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 45.0, 'Sex': 'female'}, {'Pclass': 1, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 2, 'Age': 42.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 36.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 28.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'female'}, {'Pclass': 3, 'Age': 18.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 24.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 32.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 3, 'Age': 18.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'female'}, {'Pclass': 2, 'Age': 42.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 2, 'Age': 19.0, 'Sex': 'female'}, {'Pclass': 1, 'Age': 49.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 20.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 2, 'Age': 50.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 21.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 1.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 21.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 45.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 1, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 3, 'Age': 39.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 21.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 28.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 56.0, 'Sex': 'female'}, {'Pclass': 1, 'Age': 51.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 14.0, 'Sex': 'female'}, {'Pclass': 2, 'Age': 18.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 1, 'Age': 22.0, 'Sex': 'female'}, {'Pclass': 1, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 3, 'Age': 21.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 20.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 36.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 28.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 23.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 44.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 20.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 22.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 28.5, 'Sex': 'male'}, {'Pclass': 3, 'Age': 4.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 16.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 66.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'female'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'female'}, {'Pclass': 2, 'Age': 29.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 17.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 28.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 21.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 24.0, 'Sex': 'female'}, {'Pclass': 1, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'female'}, {'Pclass': 3, 'Age': 45.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 28.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 41.0, 'Sex': 'female'}, {'Pclass': 1, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 3, 'Age': 40.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 36.0, 'Sex': 'female'}, {'Pclass': 2, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 3, 'Age': 21.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 35.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 49.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'female'}, {'Pclass': 1, 'Age': 40.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 18.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 3, 'Age': 19.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 32.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 31.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 58.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'female'}, {'Pclass': 1, 'Age': 52.0, 'Sex': 'female'}, {'Pclass': 2, 'Age': 31.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 70.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 20.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'female'}, {'Pclass': 1, 'Age': 22.0, 'Sex': 'female'}, {'Pclass': 1, 'Age': 27.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 2, 'Age': 18.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 3, 'Age': 23.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 19.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 33.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 16.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 33.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 26.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 1, 'Age': 64.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 3, 'Age': 45.0, 'Sex': 'female'}, {'Pclass': 2, 'Age': 54.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 37.0, 'Sex': 'female'}, {'Pclass': 2, 'Age': 29.69911764705882, 'Sex': 'female'}, {'Pclass': 3, 'Age': 26.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 47.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 14.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 2, 'Age': 4.0, 'Sex': 'female'}, {'Pclass': 1, 'Age': 17.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 16.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 1, 'Age': 58.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 18.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 16.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'female'}, {'Pclass': 1, 'Age': 39.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 40.0, 'Sex': 'female'}, {'Pclass': 1, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 3, 'Age': 34.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 56.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 28.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 35.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 3, 'Age': 15.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 26.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 0.67, 'Sex': 'male'}, {'Pclass': 2, 'Age': 33.0, 'Sex': 'female'}, {'Pclass': 2, 'Age': 57.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 21.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 2, 'Age': 30.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 24.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 35.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.0, 'Sex': 'female'}, {'Pclass': 1, 'Age': 43.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 30.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 40.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 18.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 38.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 45.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 3, 'Age': 31.0, 'Sex': 'female'}, {'Pclass': 2, 'Age': 23.0, 'Sex': 'female'}, {'Pclass': 2, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 3, 'Age': 30.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 33.0, 'Sex': 'female'}, {'Pclass': 1, 'Age': 30.0, 'Sex': 'female'}, {'Pclass': 1, 'Age': 39.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 33.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 33.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 48.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 29.0, 'Sex': 'female'}, {'Pclass': 2, 'Age': 21.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 48.0, 'Sex': 'female'}, {'Pclass': 2, 'Age': 24.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 25.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 23.0, 'Sex': 'female'}, {'Pclass': 2, 'Age': 52.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 3, 'Age': 16.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'female'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'female'}, {'Pclass': 3, 'Age': 18.0, 'Sex': 'female'}, {'Pclass': 1, 'Age': 24.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 35.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 16.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 31.0, 'Sex': 'female'}, {'Pclass': 2, 'Age': 28.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 27.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 15.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 3, 'Age': 16.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 45.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 17.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 28.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 33.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 33.0, 'Sex': 'female'}, {'Pclass': 2, 'Age': 8.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'female'}, {'Pclass': 2, 'Age': 25.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 34.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 41.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 17.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 3, 'Age': 19.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 3, 'Age': 22.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 32.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 25.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 27.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 29.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 25.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 20.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 2.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 2, 'Age': 7.0, 'Sex': 'female'}, {'Pclass': 2, 'Age': 8.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 5.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 11.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 27.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 31.0, 'Sex': 'female'}, {'Pclass': 2, 'Age': 16.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 33.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 34.0, 'Sex': 'female'}, {'Pclass': 2, 'Age': 24.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 42.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 32.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 3, 'Age': 19.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 62.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 37.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 23.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 21.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 24.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 5.0, 'Sex': 'female'}, {'Pclass': 2, 'Age': 31.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 41.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 2, 'Age': 18.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 44.0, 'Sex': 'female'}, {'Pclass': 1, 'Age': 35.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 20.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 51.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 27.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 47.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'female'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 3, 'Age': 17.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 30.0, 'Sex': 'female'}, {'Pclass': 1, 'Age': 4.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 57.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 36.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 65.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 48.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 17.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 22.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'female'}, {'Pclass': 3, 'Age': 20.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 36.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 22.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 1, 'Age': 40.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 34.0, 'Sex': 'female'}, {'Pclass': 1, 'Age': 25.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 24.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 40.0, 'Sex': 'female'}, {'Pclass': 1, 'Age': 62.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 26.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 2, 'Age': 18.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 45.5, 'Sex': 'male'}, {'Pclass': 3, 'Age': 44.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 31.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 11.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 19.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 24.0, 'Sex': 'female'}, {'Pclass': 1, 'Age': 64.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 22.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 19.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 7.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 27.0, 'Sex': 'female'}, {'Pclass': 1, 'Age': 31.0, 'Sex': 'female'}, {'Pclass': 1, 'Age': 34.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 16.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 6.0, 'Sex': 'female'}, {'Pclass': 1, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 2, 'Age': 28.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 29.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 30.0, 'Sex': 'female'}, {'Pclass': 1, 'Age': 31.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 49.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 31.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 34.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 18.0, 'Sex': 'female'}, {'Pclass': 2, 'Age': 54.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 2, 'Age': 31.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 33.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 36.5, 'Sex': 'male'}, {'Pclass': 2, 'Age': 24.0, 'Sex': 'female'}, {'Pclass': 1, 'Age': 55.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 25.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 25.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 19.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 3, 'Age': 5.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 17.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 71.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 54.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 50.0, 'Sex': 'female'}, {'Pclass': 2, 'Age': 22.0, 'Sex': 'female'}, {'Pclass': 1, 'Age': 42.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 26.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 25.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 2.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 29.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 23.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 28.5, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'female'}, {'Pclass': 1, 'Age': 42.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 15.0, 'Sex': 'female'}, {'Pclass': 1, 'Age': 22.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 2, 'Age': 48.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 22.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 36.0, 'Sex': 'female'}, {'Pclass': 1, 'Age': 22.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 25.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 63.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'female'}, {'Pclass': 3, 'Age': 18.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 8.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 2, 'Age': 30.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 25.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 47.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 21.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 21.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 3, 'Age': 43.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 3, 'Age': 18.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 2, 'Age': 19.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 52.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 19.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 2, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 3, 'Age': 28.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 46.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 1.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 32.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 20.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 26.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 3.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 22.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 16.0, 'Sex': 'female'}, {'Pclass': 2, 'Age': 23.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 3, 'Age': 32.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 22.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 29.69911764705882, 'Sex': 'female'}, {'Pclass': 3, 'Age': 18.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 17.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 9.0, 'Sex': 'female'}, {'Pclass': 2, 'Age': 34.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 18.0, 'Sex': 'female'}, {'Pclass': 1, 'Age': 32.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 30.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 45.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 30.5, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 1, 'Age': 48.0, 'Sex': 'female'}, {'Pclass': 2, 'Age': 3.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 24.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 24.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'female'}, {'Pclass': 3, 'Age': 21.0, 'Sex': 'male'}, {'Pclass': 2, 'Age': 28.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 35.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 1, 'Age': 33.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 18.0, 'Sex': 'female'}, {'Pclass': 2, 'Age': 51.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 31.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 28.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 30.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 58.0, 'Sex': 'female'}, {'Pclass': 1, 'Age': 29.69911764705882, 'Sex': 'female'}, {'Pclass': 2, 'Age': 39.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 24.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 22.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 43.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 35.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 60.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'female'}, {'Pclass': 2, 'Age': 21.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'female'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 3, 'Age': 31.0, 'Sex': 'female'}, {'Pclass': 3, 'Age': 16.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'}, {'Pclass': 1, 'Age': 71.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 27.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 24.0, 'Sex': 'male'}, {'Pclass': 3, 'Age': 3.0, 'Sex': 'male'}, {'Pclass': 1, 'Age': 50.0, 'Sex': 'female'}, {'Pclass': 1, 'Age': 38.0, 'Sex': 'male'}]
/Users/lichengxiang/opt/anaconda3/lib/python3.8/site-packages/pandas/core/series.py:4463: SettingWithCopyWarning: 
A value is trying to be set on a copy of a slice from a DataFrame

See the caveats in the documentation: https://pandas.pydata.org/pandas-docs/stable/user_guide/indexing.html#returning-a-view-versus-a-copy
  return super().fillna(
*******************************
[[51.  1.  0.  1.]
 [50.  1.  1.  0.]
 [27.  1.  0.  1.]
 ...
 [ 3.  3.  0.  1.]
 [50.  1.  1.  0.]
 [38.  1.  0.  1.]]
*******************************
['Age', 'Pclass', 'Sex=female', 'Sex=male']
[[51.  1.  0.  1.]
 [50.  1.  1.  0.]
 [27.  1.  0.  1.]
 ...
 [ 3.  3.  0.  1.]
 [50.  1.  1.  0.]
 [38.  1.  0.  1.]]
准确率为： 0.8251121076233184
查看选择的参数模型： {'max_depth': 5, 'n_estimators': 200}

进程已结束,退出代码0

五。决策树的结构、本地保存

1、sklearn.tree.export_graphviz() 该函数能够导出DOT格式

tree.export_graphviz(estimator,out_file='tree.dot’,feature_names=[‘’,’’])

2、工具:(能够将dot文件转换为pdf、png)

安装graphviz

ubuntu:sudo apt-get install graphviz Mac:brew install graphviz

3、运行命令

然后我们在终端当前目录下运行这个命令

$ dot -Tpng tree.dot -o tree.png

六。决策树的优缺点以及改进

•优点：

•简单的理解和解释，树木可视化。

•需要很少的数据准备，其他技术通常需要数据归一化，

•缺点：

•决策树学习者可以创建不能很好地推广数据的过于复杂的树，这被称为过拟合。

•决策树可能不稳定，因为数据的小变化可能会导致完全不同的树被生成

•改进：

•减枝cart算法

•随机森林

七。集成学习方法-随机森林

1.定义

集成学习通过建立几个模型组合的来解决单一预测问题。它的工作原理是生成多个分类器/模型，各自独立地学习和作出预测。这些预测最后结合成单预测，因此优于任何一个单分类的做出预测。

随机森林：在机器学习中，随机森林是一个包含多个决策树的分类器，并且其输出的类别是由个别树输出的类别的众数而定。

2.算法

根据下列算法而建造每棵树：

•用N来表示训练用例（样本）的个数，M表示特征数目。

•输入特征数目m，用于确定决策树上一个节点的决策结果；其中m应远小于M。

•从N个训练用例（样本）中以有放回抽样的方式，取样N次，形成一个训练集（即bootstrap取样），并用未抽到的用例（样本）作预测，评估其误差。

3.随机抽样

如果不进行随机抽样，每棵树的训练集都一样，那么最终训练出的树分类结果也是完全一样的

4.有放回的抽样

如果不是有放回的抽样，那么每棵树的训练样本都是不同的，都是没有交集的，这样每棵树都是“有偏的”，都是绝对“片面的”（当然这样说可能不对），也就是说每棵树训练出来都是有很大的差异的；而随机森林最后分类取决于多棵树（弱分类器）的投票表决。

5.代码形式

•class sklearn.ensemble.RandomForestClassifier(n_estimators=10, criterion=’gini’,max_depth=None, bootstrap=True, random_state=None)

•随机森林分类器

•n_estimators：integer，optional（default = 10）森林里的树木数量

•criteria：string，可选（default =“gini”）分割特征的测量方法

•max_depth：integer或None，可选（默认=无）树的最大深度

•bootstrap：boolean，optional（default = True）是否在构建树时使用放回抽样

八。随机森林的优点

• 在当前所有算法中，具有极好的准确率

• 能够有效地运行在大数据集上

• 能够处理具有高维特征的输入样本，而且不需要降维

• 能够评估各个特征在分类问题上的重要性，对于缺省值问题也能够获得很好得结果

九。总结

PURE-li

关注

0
点赞
踩
0

收藏

觉得还不错? 一键收藏
打赏
0
评论
决策树及随机森林

一。认识决策树二。决策树的划分依据之一-信息增益三。常见决策树使用的算法四。决策树案例五。决策树的结构、本地保存六。决策树的优缺点以及改进七。集成学习方法-随机森林1.定义2.算法3.随机抽样4.有放回的抽样5.代码形式八。随机森林的优点九。总结
复制链接

扫一扫