pytorch读取文本训练

最新推荐文章于 2024-05-20 11:53:12 发布

weixin_34167819

最新推荐文章于 2024-05-20 11:53:12 发布

阅读量988

点赞数 1

文章标签：人工智能 python

原文链接：https://my.oschina.net/u/199488/blog/1574477

版权

2019独角兽企业重金招聘Python工程师标准>>>

# References
# https://github.com/yunjey/pytorch-tutorial/blob/master/tutorials/01-basics/pytorch_basics/main.py
# http://pytorch.org/tutorials/beginner/data_loading_tutorial.html#dataset-class
import torch
import numpy as np
from torch.autograd import Variable
from torch.utils.data import Dataset, DataLoader


class DiabetesDataset(Dataset):
    """ Diabetes dataset."""

    # Initialize your data, download, etc.
    def __init__(self):
        xy = np.loadtxt('./data/diabetes.csv.gz',
                        delimiter=',', dtype=np.float32)
        self.len = xy.shape[0]
        self.x_data = torch.from_numpy(xy[:, 0:-1])#关于np的数组操作，http://blog.csdn.net/liangzuojiayi/article/details/51534164
        self.y_data = torch.from_numpy(xy[:, [-1]])

    def __getitem__(self, index):
        return self.x_data[index], self.y_data[index]

    def __len__(self):
        return self.len


dataset = DiabetesDataset()
train_loader = DataLoader(dataset=dataset,
                          batch_size=32,
                          shuffle=True,
                          num_workers=2)

for epoch in range(2):
    for i, data in enumerate(train_loader, 0):#python enumerate用法总结
        # get the inputs
        inputs, labels = data

        # wrap them in Variable
        inputs, labels = Variable(inputs), Variable(labels)

        # Run your training process
        print(epoch, i, "inputs", inputs.data, "labels", labels.data)

pytorch读取文本训练

转载于:https://my.oschina.net/u/199488/blog/1574477