集成学习算法_简介

¥骁勇善战¥

已于 2023-09-26 12:14:39 修改

阅读量741

点赞数

文章标签：集成学习算法机器学习

于 2023-09-13 10:58:21 首次发布

本文链接：https://blog.csdn.net/m0_68462260/article/details/132847835

版权

集成学习简介

什么是集成学习

在这里插入图片描述

集成学习通过建⽴⼏个模型来解决单⼀预测问题。它的⼯作原理是⽣成多个分类器/模型，各⾃独⽴地学习和作出预测。这些预测最后结合成组合预测，因此优于任何⼀个单分类的做出预测。

集成学习中boosting和Bagging

在这里插入图片描述

Bagging集成原理

⽬标：把下⾯的圈和⽅块进⾏分类
在这里插入图片描述

实现过程：

1. 采样不同数据集
2)训练分类器
3)平权投票，获取最终结果
4)主要实现过程⼩结

随机森林构造过程

在机器学习中，随机森林是⼀个包含多个决策树的分类器，并且其输出的类别是由个别树输出的类别的众数⽽定。

随机森林 = Bagging + 决策树

包外估计 (Out-of-Bag Estimate)

随机森林的 Bagging 过程，对于每⼀颗训练出的决策树 g ，与数据集 D 有如下关系：
在这里插入图片描述

对于星号的部分，即是没有选择到的数据，称之为 Out-of-bag(OOB)数据，当数据⾜够多，对于任意⼀组数据 (x , y ) 是包外数据的概率为：
在这里插入图片描述

由于基分类器是构建在训练样本的⾃助抽样集上的，只有约 63.2％原样本集出现在中，⽽剩余的 36.8％的数据作为包外数据，可以⽤于基分类器的验证集。

随机森林api介绍

sklearn.ensemble.RandomForestClassifier(n_estimators=10, criterion=’gini’, max_depth=None, bootstrap=True, random_state=None, min_samples_split=2)

n_estimators：integer，optional(default = 10)森林⾥的树⽊数量120,200,300,500,800,1200
- 在利⽤最⼤投票数或平均值来预测之前，你想要建⽴⼦树的数量。
Criterion：string，可选(default =“gini”)
- 分割特征的测量⽅法
max_depth：integer或None，可选(默认=⽆)
- 树的最⼤深度 5,8,15,25,30
max_features="auto”,每个决策树的最⼤特征数量
- If “auto”, then max_features=sqrt(n_features) .
- If “sqrt”, then max_features=sqrt(n_features) (same as “auto”).
- If “log2”, then max_features=log2(n_features) .
- If None, then max_features=n_features .
bootstrap：boolean，optional(default = True)
- 是否在构建树时使⽤放回抽样
min_samples_split 内部节点再划分所需最⼩样本数
- 这个值限制了⼦树继续划分的条件，如果某节点的样本数少于min_samples_split，则不会继续再尝试选择最优特征来进⾏划分，默认是2。
- 如果样本量不⼤，不需要管这个值。如果样本量数量级⾮常⼤，则推荐增⼤这个值。
min_samples_leaf 叶⼦节点的最⼩样本数
- 这个值限制了叶⼦节点最少的样本数，如果某叶⼦节点数⽬⼩于样本数，则会和兄弟节点⼀起被剪枝，默认是1。
- 叶是决策树的末端节点。较⼩的叶⼦使模型更容易捕捉训练数据中的噪声。
- ⼀般来说，我更偏向于将最⼩叶⼦节点数⽬设置为⼤于50。
min_impurity_split:
- 节点划分最⼩不纯度这个值限制了决策树的增⻓，如果某节点的不纯度(基于基尼系数，均⽅差)⼩于这个阈值，则该节点不再⽣成⼦节点。即为叶⼦节点。
- ⼀般不推荐改动默认值1e-7。

随机森林预测案例

导入模块

import pandas as pd
import numpy as np
from sklearn.model_selection import train_test_split, GridSearchCV
from sklearn.feature_extraction import DictVectorizer
from sklearn.ensemble import RandomForestClassifier

获取数据

# 1.获取数据
titan = pd.read_csv("./data/titanic/train.csv")
titan

	PassengerId	Survived	Pclass	Name	Sex	Age	SibSp	Parch	Ticket	Fare	Cabin	Embarked
0	1	0	3	Braund, Mr. Owen Harris	male	22.0	1	0	A/5 21171	7.2500	NaN	S
1	2	1	1	Cumings, Mrs. John Bradley (Florence Briggs Th...	female	38.0	1	0	PC 17599	71.2833	C85	C
2	3	1	3	Heikkinen, Miss. Laina	female	26.0	0	0	STON/O2. 3101282	7.9250	NaN	S
3	4	1	1	Futrelle, Mrs. Jacques Heath (Lily May Peel)	female	35.0	1	0	113803	53.1000	C123	S
4	5	0	3	Allen, Mr. William Henry	male	35.0	0	0	373450	8.0500	NaN	S
...	...	...	...	...	...	...	...	...	...	...	...	...
886	887	0	2	Montvila, Rev. Juozas	male	27.0	0	0	211536	13.0000	NaN	S
887	888	1	1	Graham, Miss. Margaret Edith	female	19.0	0	0	112053	30.0000	B42	S
888	889	0	3	Johnston, Miss. Catherine Helen "Carrie"	female	NaN	1	2	W./C. 6607	23.4500	NaN	S
889	890	1	1	Behr, Mr. Karl Howell	male	26.0	0	0	111369	30.0000	C148	C
890	891	0	3	Dooley, Mr. Patrick	male	32.0	0	0	370376	7.7500	NaN	Q

891 rows × 12 columns

titan.describe()

	PassengerId	Survived	Pclass	Age	SibSp	Parch	Fare
count	891.000000	891.000000	891.000000	714.000000	891.000000	891.000000	891.000000
mean	446.000000	0.383838	2.308642	29.699118	0.523008	0.381594	32.204208
std	257.353842	0.486592	0.836071	14.526497	1.102743	0.806057	49.693429
min	1.000000	0.000000	1.000000	0.420000	0.000000	0.000000	0.000000
25%	223.500000	0.000000	2.000000	20.125000	0.000000	0.000000	7.910400
50%	446.000000	0.000000	3.000000	28.000000	0.000000	0.000000	14.454200
75%	668.500000	1.000000	3.000000	38.000000	1.000000	0.000000	31.000000
max	891.000000	1.000000	3.000000	80.000000	8.000000	6.000000	512.329200

数据基本处理

# 确定特征值,目标值
x = titan[["Pclass", "Age", "Sex"]]
y = titan["Survived"]

x.head()

	Pclass	Age	Sex
0	3	22.0	male
1	1	38.0	female
2	3	26.0	female
3	1	35.0	female
4	3	35.0	male

y.head()

0    0
1    1
2    1
3    1
4    0
Name: Survived, dtype: int64

# 缺失值处理 -- 平均值填充
x['Age'].fillna(value=titan["Age"].mean(), inplace=True)

# 数据集划分
x_train, x_test, y_train, y_test = train_test_split(x, y, random_state=22, test_size=0.2)

特征工程(字典特征抽取)

x_train

	Pclass	Age	Sex
793	1	29.699118	male
814	3	30.500000	male
43	2	3.000000	female
269	1	35.000000	female
538	3	29.699118	male
...	...	...	...
358	3	29.699118	female
356	1	22.000000	female
812	2	35.000000	male
132	3	47.000000	female
885	3	39.000000	female

712 rows × 3 columns

x_train = x_train.to_dict(orient="records") # 转换成字典形式
x_test = x_test.to_dict(orient="records")
x_train

[{'Pclass': 1, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 30.5, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 3.0, 'Sex': 'female'},
 {'Pclass': 1, 'Age': 35.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 32.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 32.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 17.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 39.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 23.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 31.0, 'Sex': 'female'},
 {'Pclass': 1, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 26.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 34.5, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 40.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 24.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 2.0, 'Sex': 'female'},
 {'Pclass': 2, 'Age': 33.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 29.69911764705882, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 31.0, 'Sex': 'female'},
 {'Pclass': 1, 'Age': 17.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 43.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 56.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 38.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 25.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 2.0, 'Sex': 'female'},
 {'Pclass': 2, 'Age': 28.0, 'Sex': 'female'},
 {'Pclass': 2, 'Age': 41.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 51.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 40.0, 'Sex': 'female'},
 {'Pclass': 1, 'Age': 56.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 50.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 23.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 28.0, 'Sex': 'female'},
 {'Pclass': 1, 'Age': 44.0, 'Sex': 'female'},
 {'Pclass': 2, 'Age': 28.0, 'Sex': 'female'},
 {'Pclass': 1, 'Age': 45.5, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 38.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 18.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 30.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 32.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 45.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 4.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 31.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 22.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 27.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 43.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 37.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 18.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 14.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 10.0, 'Sex': 'female'},
 {'Pclass': 2, 'Age': 27.0, 'Sex': 'female'},
 {'Pclass': 1, 'Age': 41.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 20.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 0.75, 'Sex': 'female'},
 {'Pclass': 2, 'Age': 66.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 31.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 34.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 39.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 40.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 39.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'female'},
 {'Pclass': 1, 'Age': 48.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 39.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 18.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 25.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 33.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 25.0, 'Sex': 'female'},
 {'Pclass': 1, 'Age': 21.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 20.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 21.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 43.0, 'Sex': 'female'},
 {'Pclass': 1, 'Age': 42.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 16.0, 'Sex': 'female'},
 {'Pclass': 1, 'Age': 23.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 40.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 16.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 24.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 31.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 21.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 44.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 30.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 19.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 40.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 51.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 22.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 24.5, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 65.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 3.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 27.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 54.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 45.5, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 32.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 29.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 42.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 45.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 44.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 42.0, 'Sex': 'female'},
 {'Pclass': 1, 'Age': 35.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 28.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 24.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 28.0, 'Sex': 'female'},
 {'Pclass': 2, 'Age': 34.0, 'Sex': 'female'},
 {'Pclass': 1, 'Age': 29.69911764705882, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 40.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 21.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 36.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 45.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 6.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 18.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 34.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 58.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 23.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 28.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 42.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 40.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 14.5, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 44.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 35.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 1.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'female'},
 {'Pclass': 1, 'Age': 48.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 17.0, 'Sex': 'female'},
 {'Pclass': 1, 'Age': 36.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 30.0, 'Sex': 'female'},
 {'Pclass': 2, 'Age': 32.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'female'},
 {'Pclass': 1, 'Age': 44.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 26.0, 'Sex': 'female'},
 {'Pclass': 1, 'Age': 30.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 15.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 37.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 28.0, 'Sex': 'female'},
 {'Pclass': 2, 'Age': 35.0, 'Sex': 'female'},
 {'Pclass': 1, 'Age': 62.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 22.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 1.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 24.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 16.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 20.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 9.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 30.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 18.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 34.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 27.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 17.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 20.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 18.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 11.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 44.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 14.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 36.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 21.0, 'Sex': 'female'},
 {'Pclass': 2, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 23.5, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 37.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 12.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 28.5, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 16.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 19.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 39.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 8.0, 'Sex': 'female'},
 {'Pclass': 1, 'Age': 35.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 19.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 19.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 25.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 2.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'female'},
 {'Pclass': 1, 'Age': 25.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 24.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 43.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 48.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 18.0, 'Sex': 'female'},
 {'Pclass': 1, 'Age': 45.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 26.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 30.0, 'Sex': 'female'},
 {'Pclass': 2, 'Age': 32.5, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 0.92, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 18.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 48.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 38.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 35.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 54.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 20.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 30.0, 'Sex': 'female'},
 {'Pclass': 2, 'Age': 31.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 31.0, 'Sex': 'female'},
 {'Pclass': 1, 'Age': 31.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 9.0, 'Sex': 'female'},
 {'Pclass': 2, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 70.5, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 20.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 42.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 26.0, 'Sex': 'female'},
 {'Pclass': 1, 'Age': 39.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 71.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 3.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 53.0, 'Sex': 'female'},
 {'Pclass': 2, 'Age': 30.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 28.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 28.0, 'Sex': 'female'},
 {'Pclass': 1, 'Age': 27.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 35.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 74.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 34.0, 'Sex': 'female'},
 {'Pclass': 1, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 47.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 32.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 50.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 21.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 22.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 25.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'female'},
 {'Pclass': 1, 'Age': 29.69911764705882, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 0.42, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 24.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 27.0, 'Sex': 'female'},
 {'Pclass': 2, 'Age': 70.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 21.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 50.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 35.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 58.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 38.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 52.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 41.0, 'Sex': 'female'},
 {'Pclass': 1, 'Age': 19.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'female'},
 {'Pclass': 1, 'Age': 16.0, 'Sex': 'female'},
 {'Pclass': 1, 'Age': 58.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 34.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 4.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 16.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 11.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 16.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 55.5, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 24.0, 'Sex': 'female'},
 {'Pclass': 2, 'Age': 50.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 21.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 36.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 18.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 22.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 18.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 25.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'female'},
 {'Pclass': 1, 'Age': 36.0, 'Sex': 'female'},
 {'Pclass': 2, 'Age': 5.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 30.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 39.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 35.0, 'Sex': 'female'},
 {'Pclass': 2, 'Age': 19.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'female'},
 {'Pclass': 1, 'Age': 30.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 1.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 19.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 24.0, 'Sex': 'female'},
 {'Pclass': 2, 'Age': 62.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 23.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 16.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 5.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 32.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 64.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 22.0, 'Sex': 'female'},
 {'Pclass': 2, 'Age': 42.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 64.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 60.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 48.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 20.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 23.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 18.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 28.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 46.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 39.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 28.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 28.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 26.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 29.0, 'Sex': 'female'},
 {'Pclass': 2, 'Age': 36.0, 'Sex': 'female'},
 {'Pclass': 2, 'Age': 19.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 32.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 47.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 29.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 36.0, 'Sex': 'female'},
 {'Pclass': 2, 'Age': 30.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 25.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 27.0, 'Sex': 'female'},
 {'Pclass': 1, 'Age': 28.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 31.0, 'Sex': 'female'},
 {'Pclass': 1, 'Age': 38.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 32.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 19.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 39.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 3.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 16.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 19.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 51.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 13.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 19.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 14.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 16.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 33.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 22.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 42.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 22.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 27.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 22.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 5.0, 'Sex': 'female'},
 {'Pclass': 2, 'Age': 40.0, 'Sex': 'female'},
 {'Pclass': 1, 'Age': 65.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 51.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 54.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 1.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 29.69911764705882, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 49.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 30.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 17.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 28.5, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 17.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 30.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 58.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 34.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 37.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 8.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 48.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 17.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 9.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 21.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 22.0, 'Sex': 'female'},
 {'Pclass': 2, 'Age': 34.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 35.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 22.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 55.0, 'Sex': 'female'},
 {'Pclass': 2, 'Age': 29.69911764705882, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 32.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 33.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 36.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 42.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 29.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 20.0, 'Sex': 'female'},
 {'Pclass': 1, 'Age': 56.0, 'Sex': 'female'},
 {'Pclass': 2, 'Age': 17.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 20.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 9.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 16.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 24.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 30.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 63.0, 'Sex': 'female'},
 {'Pclass': 1, 'Age': 45.0, 'Sex': 'female'},
 {'Pclass': 1, 'Age': 47.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 39.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 38.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 7.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 0.67, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 18.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 65.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 9.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 28.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 31.0, 'Sex': 'female'},
 {'Pclass': 2, 'Age': 27.0, 'Sex': 'female'},
 {'Pclass': 1, 'Age': 50.0, 'Sex': 'female'},
 {'Pclass': 1, 'Age': 60.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 21.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 44.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 19.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 49.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 23.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 25.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 17.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 17.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 48.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 26.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 56.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 35.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 42.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 33.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 38.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 19.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 14.0, 'Sex': 'female'},
 {'Pclass': 2, 'Age': 34.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 60.0, 'Sex': 'female'},
 {'Pclass': 2, 'Age': 8.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 19.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 40.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 28.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 29.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 0.83, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 34.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 22.0, 'Sex': 'female'},
 {'Pclass': 1, 'Age': 35.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 21.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 40.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 29.69911764705882, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 26.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 24.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 16.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 13.0, 'Sex': 'female'},
 {'Pclass': 1, 'Age': 45.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 29.69911764705882, 'Sex': 'female'},
 {'Pclass': 1, 'Age': 27.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 2.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 5.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 30.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 40.0, 'Sex': 'female'},
 {'Pclass': 2, 'Age': 31.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 60.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'female'},
 {'Pclass': 2, 'Age': 36.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 36.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 30.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 45.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 20.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 24.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 33.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 22.0, 'Sex': 'female'},
 {'Pclass': 1, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 21.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 26.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 32.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 25.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 0.83, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 2.0, 'Sex': 'female'},
 {'Pclass': 2, 'Age': 24.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 31.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 61.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 35.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 50.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 19.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 27.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 42.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 1.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 61.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 26.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 3.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 22.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 26.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 24.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 4.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 41.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 47.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 18.0, 'Sex': 'female'},
 {'Pclass': 1, 'Age': 62.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'female'},
 {'Pclass': 1, 'Age': 25.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 20.5, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 9.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 39.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 22.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 28.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 54.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 26.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'female'},
 {'Pclass': 1, 'Age': 17.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 21.0, 'Sex': 'female'},
 {'Pclass': 1, 'Age': 55.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 22.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 40.5, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 27.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 30.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 70.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 4.0, 'Sex': 'female'},
 {'Pclass': 1, 'Age': 35.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 45.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 19.0, 'Sex': 'female'},
 {'Pclass': 1, 'Age': 80.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 45.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 59.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 54.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 29.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 18.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 42.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 14.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'female'},
 {'Pclass': 2, 'Age': 34.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 29.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 19.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 18.0, 'Sex': 'female'},
 {'Pclass': 2, 'Age': 19.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 34.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 44.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 32.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 25.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 15.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 2.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 25.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 52.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 24.0, 'Sex': 'female'},
 {'Pclass': 2, 'Age': 32.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 21.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 18.0, 'Sex': 'female'},
 {'Pclass': 2, 'Age': 19.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 22.0, 'Sex': 'female'},
 {'Pclass': 1, 'Age': 24.0, 'Sex': 'female'},
 {'Pclass': 2, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 18.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 39.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 28.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 26.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 30.0, 'Sex': 'female'},
 {'Pclass': 2, 'Age': 25.0, 'Sex': 'female'},
 {'Pclass': 2, 'Age': 57.0, 'Sex': 'female'},
 {'Pclass': 1, 'Age': 49.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 6.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'female'},
 {'Pclass': 2, 'Age': 24.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 4.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 15.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 27.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 33.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 48.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 22.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 31.0, 'Sex': 'female'},
 {'Pclass': 1, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 36.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 4.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 1.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 28.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 25.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 17.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 16.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 29.69911764705882, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 26.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 32.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 28.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 11.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 22.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 4.0, 'Sex': 'female'},
 {'Pclass': 1, 'Age': 31.0, 'Sex': 'female'},
 {'Pclass': 2, 'Age': 24.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 28.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 21.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 4.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 23.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 47.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 24.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 0.75, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 22.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 25.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 16.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 36.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 24.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 71.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 22.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'female'},
 {'Pclass': 1, 'Age': 21.0, 'Sex': 'female'},
 {'Pclass': 2, 'Age': 36.0, 'Sex': 'female'},
 {'Pclass': 1, 'Age': 52.0, 'Sex': 'female'},
 {'Pclass': 2, 'Age': 19.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 2.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 18.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 23.0, 'Sex': 'female'},
 {'Pclass': 2, 'Age': 29.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 27.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 40.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 27.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 36.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 22.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 41.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 28.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'female'},
 {'Pclass': 1, 'Age': 24.0, 'Sex': 'female'},
 {'Pclass': 1, 'Age': 61.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 51.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 36.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 26.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 49.0, 'Sex': 'female'},
 {'Pclass': 2, 'Age': 46.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 22.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 18.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 35.0, 'Sex': 'female'},
 {'Pclass': 2, 'Age': 19.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 7.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 2.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 45.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 8.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 24.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 34.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 9.0, 'Sex': 'female'},
 {'Pclass': 2, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 28.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 22.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'female'},
 {'Pclass': 2, 'Age': 29.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 27.0, 'Sex': 'female'},
 {'Pclass': 1, 'Age': 26.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 26.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 33.0, 'Sex': 'female'},
 {'Pclass': 1, 'Age': 29.69911764705882, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 16.0, 'Sex': 'male'},
 {'Pclass': 2, 'Age': 50.0, 'Sex': 'female'},
 {'Pclass': 2, 'Age': 23.0, 'Sex': 'male'},
 {'Pclass': 1, 'Age': 25.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 2.0, 'Sex': 'female'},
 {'Pclass': 2, 'Age': 29.69911764705882, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 21.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 29.69911764705882, 'Sex': 'female'},
 {'Pclass': 1, 'Age': 22.0, 'Sex': 'female'},
 {'Pclass': 2, 'Age': 35.0, 'Sex': 'male'},
 {'Pclass': 3, 'Age': 47.0, 'Sex': 'female'},
 {'Pclass': 3, 'Age': 39.0, 'Sex': 'female'}]

transfer = DictVectorizer()

x_train = transfer.fit_transform(x_train)
x_test = transfer.fit_transform(x_test)

names = transfer.get_feature_names()
print("属性名字是:\n", names)
print(x_train.toarray())

属性名字是:
 ['Age', 'Pclass', 'Sex=female', 'Sex=male']
[[29.69911765  1.          0.          1.        ]
 [30.5         3.          0.          1.        ]
 [ 3.          2.          1.          0.        ]
 ...
 [35.          2.          0.          1.        ]
 [47.          3.          1.          0.        ]
 [39.          3.          1.          0.        ]]

机器学习( 随机森林 + cv )

estimator = RandomForestClassifier()

param_grid = {"n_estimators": [120,200,300,500,800,1200], "max_depth": [5, 8, 15, 25, 30]}
estimator = GridSearchCV(estimator, param_grid=param_grid, cv=3)

estimator.fit(x_train, y_train)

GridSearchCV(cv=3, estimator=RandomForestClassifier(),
             param_grid={'max_depth': [5, 8, 15, 25, 30],
                         'n_estimators': [120, 200, 300, 500, 800, 1200]})

模型评估

# 预测值
y_pre = estimator.predict(x_test)
y_pre

array([1, 0, 0, 1, 1, 0, 1, 0, 0, 1, 1, 1, 0, 0, 0, 0, 1, 0, 1, 0, 1, 0,
       1, 0, 0, 0, 0, 0, 1, 0, 0, 0, 1, 1, 1, 0, 0, 0, 0, 0, 0, 1, 1, 1,
       1, 0, 0, 0, 1, 0, 1, 0, 0, 0, 0, 0, 0, 0, 1, 1, 0, 0, 0, 1, 0, 0,
       0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 1, 0,
       0, 0, 1, 0, 0, 0, 1, 0, 0, 0, 0, 1, 1, 1, 0, 0, 1, 0, 0, 1, 0, 0,
       0, 0, 1, 1, 1, 0, 1, 0, 0, 1, 0, 1, 0, 0, 1, 0, 0, 0, 1, 1, 0, 0,
       0, 1, 0, 1, 1, 1, 0, 0, 1, 0, 0, 0, 0, 0, 0, 1, 0, 0, 1, 0, 1, 0,
       0, 1, 1, 0, 1, 1, 0, 0, 0, 0, 0, 1, 0, 1, 0, 1, 0, 1, 0, 0, 1, 1,
       1, 0, 0])

# 最优参数
estimator.best_estimator_

RandomForestClassifier(max_depth=5, n_estimators=300)

¥骁勇善战¥

关注

0
点赞
踩
0

收藏

觉得还不错? 一键收藏
打赏
0
评论
集成学习算法_简介

集成学习通过建⽴⼏个模型来解决单⼀预测问题。它的⼯作原理是⽣成多个分类器/模型，各⾃独⽴地学习和作出预测。这些预测最后结合成组合预测，因此优于任何⼀个单分类的做出预测。n_estimators：integer，optional(default = 10)森林⾥的树⽊数量120,200,300,500,800,1200在利⽤最⼤投票数或平均值来预测之前，你想要建⽴⼦树的数量。Criterion：string，可选(default =“gini”)分割特征的测量⽅法。
复制链接

扫一扫