学习笔记：用集成模型预测泰坦尼克号伤亡情况（与单一决策树进行对比）

代码如下:

# -*- coding: utf-8 -*-
"""
Created on Mon May 14 09:29:48 2018

@author: eagle
"""

# =============================================================================
# 单一决策树与集成模型（随机森林分类器和梯度提升决策树）对比预测
# 泰坦尼克伤亡情况
# =============================================================================

import pandas as pd
from sklearn.cross_validation import train_test_split
from sklearn.feature_extraction import DictVectorizer
from sklearn.tree import DecisionTreeClassifier
from sklearn.metrics import classification_report
from sklearn.ensemble import RandomForestClassifier
from sklearn.ensemble import GradientBoostingClassifier

#读取数据
titanic = pd.read_csv('http://biostat.mc.vanderbilt.edu/wiki/pub/Main/DataSets/titanic.txt')
#titanic.head()
#titanic.info()   #共1313条信息

#选取特征
X = titanic[['pclass','age','sex']]
y = titanic['survived']
#X.info()
X['age'].fillna(X['age'].mean(),inplace = True)     #用中位数填充

#数据分割
X_train,X_test,y_train,y_test = train_test_split(X,y,test_size = 0.25,random_state = 33)


#特征转换
vec=DictVectorizer(sparse=False)
X_train=vec.fit_transform(X_train.to_dict(orient='record'))
#print(vec.feature_names_)
X_test=vec.transform(X_test.to_dict(orient='record'))

# =============================================================================
# 不同决策树对比
# =============================================================================

#1、用单一决策树进行预测
dtc=DecisionTreeClassifier()
#训练
dtc.fit(X_train,y_train)
#预测
dtc_y_predict=dtc.predict(X_test)

#2、用随机森林分类器进行集成模型的训练及预测分析
rfc = RandomForestClassifier()
rfc.fit(X_train,y_train)
rfc_y_predict=rfc.predict(X_test)

#3、使用梯度上升决策树进行集成模型的训练及预测分析
gbc = GradientBoostingClassifier()
gbc.fit(X_train,y_train)
gbc_y_predict=gbc.predict(X_test)

#预测效果对比

print('The Accuracy of DecisionTree is:',dtc.score(X_test,y_test))
print(classification_report(y_test,dtc_y_predict,target_names=['died','survived']))

print('The Accuracy of RandomForestClassifier is:',rfc.score(X_test,y_test))
print(classification_report(y_test,rfc_y_predict,target_names=['died','survived']))

print('The Accuracy of GradietBoostingClassifier is:',gbc.score(X_test,y_test))
print(classification_report(y_test,gbc_y_predict,target_names=['died','survived']))

结果与书上并不一致，运行结果为:

The Accuracy of DecisionTree is: 0.781155015198

The Accuracy of RandomForestClassifier is: 0.775075987842

The Accuracy of GradietBoostingClassifier is: 0.790273556231