aws(学习笔记第二十五课) 使用aws batch

sealaugh32

于 2025-01-18 19:52:09 发布

阅读量1k

点赞数 21

分类专栏： aws 文章标签： aws 学习笔记

本文链接：https://blog.csdn.net/sealaugh1980/article/details/145216930

版权

aws(学习笔记第二十五课)

使用aws batch

学习内容：

aws batch整体架构
aws batch的hands on

1. `aws batch`整体架构

AWS batch的整体架构
相对online开发而言，batch也是一个另外的一个开发领域。AWS的batch开发，既可以采用EC2，也可以采用Fargate。
- 用户通过各种方式将job放入到job queue
- AWS batch将job queue里面的job取出
- 之后将job通过Fargate或者EC2进行执行
  
  接下来，hands on采用Fargate的方式进行练习。
AWS batch的创建步骤
- 创建compute environment
- 创建job queue，这时候会绑定建立好的compute environment
- 创建job definition
- 最后创建job

2.`aws batch`的`hands on`

首先定义计算环境compute environment

定义计算环境

使用Fargate和默认的role

这里的role，使用默认的，之后查看AWS设定该role的权限和信任关系。
查看AWSServiceRoleForBatch

权限设定
可以看出都是EC2和ECS以及autoscaling相关的权限。

{
         
   "Version": "2012-10-17",
   "Statement": [
       {
         
           "Sid": "AWSBatchPolicyStatement1",
           "Effect": "Allow",
           "Action": [
               "ec2:DescribeAccountAttributes",
               "ec2:DescribeInstances",
               "ec2:DescribeInstanceStatus",
               "ec2:DescribeInstanceAttribute",
               "ec2:DescribeSubnets",
               "ec2:DescribeSecurityGroups",
               "ec2:DescribeKeyPairs",
               "ec2:DescribeImages",
               "ec2:DescribeImageAttribute",
               "ec2:DescribeSpotInstanceRequests",
               "ec2:DescribeSpotFleetInstances",
               "ec2:DescribeSpotFleetRequests",
               "ec2:DescribeSpotPriceHistory",
               "ec2:DescribeSpotFleetRequestHistory",
               "ec2:DescribeVpcClassicLink",
               "ec2:DescribeLaunchTemplateVersions",
               "ec2:RequestSpotFleet",
               "autoscaling:DescribeAccountLimits",
               "autoscaling:DescribeAutoScalingGroups",
               "autoscaling:DescribeLaunchConfigurations",
               "autoscaling:DescribeAutoScalingInstances",
               "autoscaling:DescribeScalingActivities",
               "eks:DescribeCluster",
               "ecs:DescribeClusters",
               "ecs:DescribeContainerInstances",
               "ecs:DescribeTaskDefinition",
               "ecs:DescribeTasks",
               "ecs:ListClusters",
               "ecs:ListContainerInstances",
               "ecs:ListTaskDefinitionFamilies",
               "ecs:ListTaskDefinitions",
               "ecs:ListTasks",
               "ecs:DeregisterTaskDefinition",
               "ecs:TagResource",
               "ecs:ListAccountSettings",
               "logs:DescribeLogGroups",
               "iam:GetInstanceProfile",
               "iam:GetRole"
           ],
           "Resource": "*"
       }