SageMaker PyTorch 训练工具包教程

SageMaker PyTorch 训练工具包教程

sagemaker-pytorch-training-toolkitToolkit for running PyTorch training scripts on SageMaker. Dockerfiles used for building SageMaker Pytorch Containers are at https://github.com/aws/deep-learning-containers.项目地址:https://gitcode.com/gh_mirrors/sa/sagemaker-pytorch-training-toolkit

项目介绍

SageMaker PyTorch 训练工具包是一个开源库，用于在 Amazon SageMaker 上使用 PyTorch 训练模型。该工具包依赖并扩展了基础的 SageMaker 训练工具包，提供了 PyTorch 特定的支持。

项目快速启动

安装

首先，克隆项目仓库：

git clone https://github.com/aws/sagemaker-pytorch-training-toolkit.git
cd sagemaker-pytorch-training-toolkit

配置环境

创建并激活虚拟环境：

python -m venv venv
source venv/bin/activate

安装必要的依赖：

pip install -r requirements.txt

运行示例

以下是一个简单的 PyTorch 训练脚本示例：

import torch
import torch.nn as nn
import torch.optim as optim

# 定义一个简单的神经网络
class SimpleNet(nn.Module):
    def __init__(self):
        super(SimpleNet, self).__init__()
        self.fc = nn.Linear(10, 1)

    def forward(self, x):
        return self.fc(x)

# 创建模型实例
model = SimpleNet()

# 定义损失函数和优化器
criterion = nn.MSELoss()
optimizer = optim.SGD(model.parameters(), lr=0.01)

# 生成一些假数据
inputs = torch.randn(5, 10)
targets = torch.randn(5, 1)

# 训练模型
for epoch in range(100):
    optimizer.zero_grad()
    outputs = model(inputs)
    loss = criterion(outputs, targets)
    loss.backward()
    optimizer.step()
    print(f'Epoch {epoch+1}, Loss: {loss.item()}')

将上述脚本保存为 train.py，然后在 SageMaker 上运行：

python train.py

应用案例和最佳实践

应用案例

SageMaker PyTorch 训练工具包广泛应用于各种深度学习任务，如图像分类、自然语言处理和推荐系统等。以下是一个图像分类的示例：

import torchvision.models as models
import torchvision.transforms as transforms
from torch.utils.data import DataLoader
from torchvision.datasets import CIFAR10

# 加载预训练的 ResNet 模型
model = models.resnet18(pretrained=True)

# 修改最后一层以适应 CIFAR10 数据集
num_ftrs = model.fc.in_features
model.fc = nn.Linear(num_ftrs, 10)

# 定义数据预处理
transform = transforms.Compose([
    transforms.RandomResizedCrop(224),
    transforms.RandomHorizontalFlip(),
    transforms.ToTensor(),
    transforms.Normalize(mean=[0.485, 0.456, 0.406], std=[0.229, 0.224, 0.225]),
])

# 加载 CIFAR10 数据集
trainset = CIFAR10(root='./data', train=True, download=True, transform=transform)
trainloader = DataLoader(trainset, batch_size=32, shuffle=True, num_workers=2)

# 定义损失函数和优化器
criterion = nn.CrossEntropyLoss()
optimizer = optim.SGD(model.parameters(), lr=0.001, momentum=0.9)

# 训练模型
for epoch in range(10):
    running_loss = 0.0
    for i, data in enumerate(trainloader, 0):
        inputs, labels = data
        optimizer.zero_grad()
        outputs = model(inputs)
        loss = criterion(outputs, labels)
        loss.backward()
        optimizer.step()
        running_loss += loss.item()
    print(f'Epoch {epoch+1}, Loss: {running_loss/len(trainloader)}')

最佳实践

1. 使用预训练模型：利用预训练的模型可以

sagemaker-pytorch-training-toolkitToolkit for running PyTorch training scripts on SageMaker. Dockerfiles used for building SageMaker Pytorch Containers are at https://github.com/aws/deep-learning-containers.项目地址:https://gitcode.com/gh_mirrors/sa/sagemaker-pytorch-training-toolkit