python中的dataframe 剔除部分数据后，索引消失，重新建立索引

最新推荐文章于 2024-07-06 03:18:50 发布

IT界的小小小学生

最新推荐文章于 2024-07-06 03:18:50 发布

阅读量5.3k

点赞数 3

分类专栏： python 文章标签： datafrmae pandasapply lambda

本文链接：https://blog.csdn.net/HHTNAN/article/details/83178095

版权

python 专栏收录该内容

149 篇文章 11 订阅

订阅专栏

今天在处理一个数据的过程中出现问题，python中的dataframe 剔除部分数据后，索引消失，遍历就出错，

报错形式如下

Traceback (most recent call last):
  File "D:/pycreate/tianchi_糖尿病/data_pre/split_data.py", line 53, in <module>
    handler_data()
  File "D:/pycreate/tianchi_糖尿病/data_pre/split_data.py", line 32, in handler_data
    print(indexdf["S"][i])
  File "D:\ANACONDA\ana3.5.2\lib\site-packages\pandas\core\series.py", line 766, in __getitem__
    result = self.index.get_value(self, key)
  File "D:\ANACONDA\ana3.5.2\lib\site-packages\pandas\core\indexes\base.py", line 3103, in get_value
    tz=getattr(series.dtype, 'tz', None))
  File "pandas\_libs\index.pyx", line 106, in pandas._libs.index.IndexEngine.get_value
  File "pandas\_libs\index.pyx", line 114, in pandas._libs.index.IndexEngine.get_value
  File "pandas\_libs\index.pyx", line 162, in pandas._libs.index.IndexEngine.get_loc
  File "pandas\_libs\hashtable_class_helper.pxi", line 958, in pandas._libs.hashtable.Int64HashTable.get_item
  File "pandas\_libs\hashtable_class_helper.pxi", line 964, in pandas._libs.hashtable.Int64HashTable.get_item
KeyError: 31

后来找了以下是由于我对原始数据删除了部分异常数据导致的，。

#会导致原索引丢失，30-32
    indexdf=indexdf[indexdf["EE"]!=0]

解决方案

   #重新定义索引，才能支持遍历
    # indexdf = indexdf.reset_index(drop=True)

代码：

  indexdf=pd.read_table("0.ann",sep="\s+",names=["T","TC","S","E","name"])
  indexdf["EE"] = indexdf["E"].apply(lambda x: x if ";" not in x else 0)
  indexdf=indexdf[indexdf["EE"]!=0]
        #重新定义索引，才能支持遍历
 indexdf = indexdf.reset_index(drop=True)
 for i in range(len(indexdf)):
    
            print(indexdf["S"][i])

pandas 使用apply 处理多列数据

直接上代码

import pandas as pd
def my_min(a, b):
    return min(abs(a),abs(b)


s = pd.Series([10.0247,10.0470, 10.0647,10.0761,15.0800,10.0761,10.0647,10.0470,10.0247,10.0,9.9753,9.9530,9.9353,9.9239,18.92,9.9239,9.9353,9.9530,9.9753,10.0])
df = pd.DataFrame(s)
df.columns=['value']
df['val_1'] = df['value'].diff()
df['val_2'] = df['val_1'].shift(-1)
df['val'] = df.apply(lambda row: my_min(row['val_1'], row['val_2']), axis=1)

欢迎加入Python快速进阶QQ群：867300100