Azkaban脚本模板

最新推荐文章于 2023-03-25 08:30:00 发布

99滴神

最新推荐文章于 2023-03-25 08:30:00 发布

阅读量194

点赞数

分类专栏： azkaban 文章标签： azkaban

本文链接：https://blog.csdn.net/li1351026473/article/details/120145933

版权

azkaban 专栏收录该内容

3 篇文章 0 订阅

订阅专栏

本文介绍了如何将.project和.flow文件打包成zip并上传到Azkaban执行。示例展示了不同工作流配置，包括简单任务依赖（jobA、jobB、jobC）和嵌套工作流（embedded_flow）。

摘要由CSDN通过智能技术生成

步骤：将 ***.project和***.flow 打包成zip ，然后上传到azkaban就好了

示例1：test.zip

test.project

azkaban-flow-version: 2.0

test.flow

nodes:

   - name: jobA
     type: command
     config:
        command: echo "this is a simple test"

示例2：test2.zip

test.project

azkaban-flow-version: 2.0

test2.flow

nodes:
  - name: jobE
    type: command
    config:
      command: echo "This is job E"
    # jobE depends on jobD
    dependsOn: 
      - jobD
    
  - name: jobD
    type: command
    config:
      command: echo "This is job D"
    # jobD depends on jobA、jobB、jobC
    dependsOn:
      - jobA
      - jobB
      - jobC

  - name: jobA
    type: command
    config:
      command: echo "This is job A"

  - name: jobB
    type: command
    config:
      command: echo "This is job B"

  - name: jobC
    type: command
    config:
      command: echo "This is job C"

示例3：test3.zip

test.project

azkaban-flow-version: 2.0

test3.flow

nodes:
  - name: jobC
    type: command
    config:
      command: echo "This is job C"
    dependsOn:
      - embedded_flow

  - name: embedded_flow
    type: flow
    config:
      prop: ${value}
    nodes:
      - name: jobB
        type: command
        config:
          command: echo "This is job B ${prop}"
        dependsOn:
          - jobA

      - name: jobA
        type: command
        config:
          command: echo "This is job A"