机器学习算法训练时涉及到的文件读取问题汇总(更新中)

问题描述:

现有一个文件夹下多个CSV数据文件,他们的命名规则如下图

现在要循环读出他们的内部内容合并成为一个文件(或者一个矩阵)

代码:

import os
import numpy as np
from pandas import read_csv

path="/home/chen/PycharmProjects/avoidance/data"  #待读取的文件夹
path_list=os.listdir(path)
path_list.sort()    #对读取的路径进行排序,注意这样的文件最开始命名只能是 00 01 这样

f1 = open("/home/chen/PycharmProjects/avoidance/data/ImData_B00.csv", encoding='UTF-8')
data1 = np.array(read_csv(f1))
X = data1[:, 0:10]  # 数据 
y = data1[:, 10]    # label

for filename in path_list:
	f = open(os.path.join(path,filename), encoding='UTF-8')
	"""
	data = np.array(read_csv(f))
	X1 = data[:, 0:10]
	y1 = data[:, 10]
	X = np.r_[X,X1]     # np.r_[] 的用法就是把两个矩阵按列拼接
	y = np.r_[y,y1]     # 相应的按行拼接是 np.c_[]
	"""
	print(os.path.join(path,filename))

输出结果:

/home/chen/anaconda3/bin/python /home/chen/PycharmProjects/avoidance/tryagain.py
/home/chen/PycharmProjects/avoidance/data/ImData_B00.csv
/home/chen/PycharmProjects/avoidance/data/ImData_B01.csv
/home/chen/PycharmProjects/avoidance/data/ImData_B02.csv
/home/chen/PycharmProjects/avoidance/data/ImData_B03.csv
/home/chen/PycharmProjects/avoidance/data/ImData_B04.csv
/home/chen/PycharmProjects/avoidance/data/ImData_B05.csv
/home/chen/PycharmProjects/avoidance/data/ImData_B06.csv
/home/chen/PycharmProjects/avoidance/data/ImData_B07.csv
/home/chen/PycharmProjects/avoidance/data/ImData_B08.csv
/home/chen/PycharmProjects/avoidance/data/ImData_B09.csv
/home/chen/PycharmProjects/avoidance/data/ImData_B10.csv
/home/chen/PycharmProjects/avoidance/data/ImData_B11.csv
/home/chen/PycharmProjects/avoidance/data/ImData_B12.csv
/home/chen/PycharmProjects/avoidance/data/ImData_B13.csv
/home/chen/PycharmProjects/avoidance/data/ImData_B14.csv
/home/chen/PycharmProjects/avoidance/data/ImData_B15.csv
/home/chen/PycharmProjects/avoidance/data/ImData_B16.csv
/home/chen/PycharmProjects/avoidance/data/ImData_B17.csv
/home/chen/PycharmProjects/avoidance/data/ImData_B18.csv
/home/chen/PycharmProjects/avoidance/data/ImData_B19.csv
/home/chen/PycharmProjects/avoidance/data/ImData_B20.csv
/home/chen/PycharmProjects/avoidance/data/ImData_B21.csv
/home/chen/PycharmProjects/avoidance/data/ImData_B22.csv
/home/chen/PycharmProjects/avoidance/data/ImData_B23.csv
/home/chen/PycharmProjects/avoidance/data/ImData_B24.csv
/home/chen/PycharmProjects/avoidance/data/ImData_B25.csv
/home/chen/PycharmProjects/avoidance/data/ImData_B26.csv
/home/chen/PycharmProjects/avoidance/data/ImData_B27.csv
/home/chen/PycharmProjects/avoidance/data/ImData_B28.csv
/home/chen/PycharmProjects/avoidance/data/ImData_B29.csv
/home/chen/PycharmProjects/avoidance/data/ImData_B30.csv
/home/chen/PycharmProjects/avoidance/data/ImData_B31.csv
/home/chen/PycharmProjects/avoidance/data/ImData_B32.csv
/home/chen/PycharmProjects/avoidance/data/ImData_B33.csv
/home/chen/PycharmProjects/avoidance/data/ImData_B34.csv

Process finished with exit code 0

关于numpy的一点总结:

np.r_是按行连接两个矩阵,就是把两矩阵上下相加,要求列数相等,类似于pandas中的concat()

np.c_是按列连接两个矩阵,就是把两矩阵左右相加,要求行数相等,类似于pandas中的merge()

  • 0
    点赞
  • 0
    收藏
    觉得还不错? 一键收藏
  • 0
    评论

“相关推荐”对你有帮助么?

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值