常规操作-数据篇

1.如何合并两个csv文件

①表头一致

import pandas as pd
df1 = pd.read_csv('file1.csv')
df2 = pd.read_csv('file2.csv')
merged_df = pd.concat([df1, df2], ignore_index=True)
merged_df.to_csv('merged_file.csv', index=False)

②一个有表头，一个没有

import pandas as pd
df1 = pd.read_csv('file1.csv')
column_names = ['reviewId', 'Unnamed: 1', 'text']
df2 = pd.read_csv('file2.csv', names=column_names)
merged_df = pd.concat([df1, df2], ignore_index=True)
merged_df.to_csv('merged_file.csv', index=False)

③两个都没有表头

import pandas as pd

column_names = ['reviewId', 'Unnamed: 1', 'text']
df1 = pd.read_csv('file1.csv', names=column_names)
df2 = pd.read_csv('file2.csv', names=column_names)
merged_df = pd.concat([df1, df2], ignore_index=True)
merged_df.to_csv('merged_file.csv', index=False)

1.列表的保存和读取

①列表的保存

import pickle
my_list = [[1, 2],[ 3, 4], [5]]
file_name = "my_list.pkl"
with open(file_name, 'wb') as file:
    pickle.dump(my_list, file)

②列表的读取

返回列表，和保存前一样。

import pickle
file_name = "my_list.pkl"
with open(file_name, 'rb') as file:
    loaded_list = pickle.load(file)