数据科学【一】：dataframe基本操作（一）

数据科学【一】：dataframe基本操作（一）

数据准备

我们采用祖传泰坦尼克数据集（https://www.kaggle.com/c/titanic/data）

读入文件

使用read_csv函数读入文件

import pandas as pd

df = pd.DataFrame(pd.read_csv("train.csv"))
df.describe()

	PassengerId	Survived	Pclass	Age	SibSp	Parch	Fare
count	891.000000	891.000000	891.000000	714.000000	891.000000	891.000000	891.000000
mean	446.000000	0.383838	2.308642	29.699118	0.523008	0.381594	32.204208
std	257.353842	0.486592	0.836071	14.526497	1.102743	0.806057	49.693429
min	1.000000	0.000000	1.000000	0.420000	0.000000	0.000000	0.000000
25%	223.500000	0.000000	2.000000	20.125000	0.000000	0.000000	7.910400
50%	446.000000	0.000000	3.000000	28.000000	0.000000	0.000000	14.454200
75%	668.500000	1.000000	3.000000	38.000000	1.000000	0.000000	31.000000
max	891.000000	1.000000	3.000000	80.000000	8.000000	6.000000	512.329200

关于空值

返回含有空值的行数

def num_nans(df):
    return df.isnull().T.any().sum()

print("there are " +  str(num_nans(df)) + " rows with at least one empty value")

there are 708 rows with at least one empty value

移除含有超过200个空值的列

def drop_