数据清洗是一项复杂且繁琐的工作,同时也是整个数据分析过程中最为重要的环节。
在python中空值被显示为NaN。首先,我们要构造一个包含NaN的DataFrame对象。
>>> import numpy as np
>>> import pandas as pd
>>> from pandas import Series,DataFrame
>>> from numpy import nan as NaN
>>> data = DataFrame([[12,'man','13865626962'],[19,'woman',NaN],[17,NaN,NaN],[NaN,NaN,NaN]],columns=['age','sex','phone'])
>>> data
age sex phone
0 12.0 man 13865626962
1 19.0 woman NaN
2 17.0 NaN NaN
3 NaN NaN NaN
删除NaN
删除NaN所在的行
删除表中全部为NaN的行
>>> data.dropna(axis=0, how='all')
age sex phone
0 12.0 man 13865626962
1 19.0 woman NaN
2 17.0 NaN NaN
删除表中任何含有NaN的行
>>> data.dropna(axis=0, how='a