【笔记】Pandas 一些用法

读取Excel中指定sheet

import pandas as pd
from glob import glob

fn = "xxx.xlsx"
df = pd.read_excel(fn,sheet_name="表2-1-1")

合并多个Excel或者多个Sheet

df = pd.DataFrame()
# the glob module is used to retrieve files/pathnames matching a specified pattern
dir_filenames = sorted(glob('./*.xlsx')) # all excel files from current directory
for dir_file in dir_filenames:
    dict_xlsx = pd.read_excel(dir_file, sheet_name=None) 
    workbook = pd.concat([v_df.assign(Sheet = k) for k,v_df in dict_xlsx.items()], ignore_index=True)
    df = pd.concat([df,workbook],ignore_index=True)
print(f'shape of merged files:{df.shape}')

去除重复行

生成新的DataFrame

df.drop_duplicates()

在现有DataFrame上去除重复行

df.drop_duplicates(inplace=True)

参考资料

1、去除重复行
2、Pandas Merging 101