Azkaban Solo Server 快速入门

所用版本azkaban-3.52.0.tar.gz

1.解压

azkaban-3.52.0.tar.gz

# Build without running tests
./gradlew build -x test

# Build and install distributions
./gradlew installDist

4.启动start-solo.sh

cd /opt/azkaban-3.52.0/azkaban-solo-server/build/install/azkaban-solo-server; bin/start-solo.sh

进程为：1790 AzkabanSingleServer

开始简单使用：
1.创建flow20.project文件

azkaban-flow-version: 2.0

2.创建basic.flow文件

nodes:
  - name: jobA
    type: command
    config:
      command: echo "This is an echoed text."

3.将以上两个文件打包

Archive.zip

4.登录 hdp1:8081
创建project

导入压缩包


execute进行执行

单词统计案例：
wordcount.flow

nodes:
  - name: jobA
    type: command
    config:
      command: /opt/hadoop-2.7.3/bin/hadoop fs -mkdir -p /wc/input
  - name: jobB
    type: command
    config:
      command: /opt/hadoop-2.7.3/bin/hadoop fs -put /root/demodata/word.txt /wc/input
    dependsOn:
      - jobA
  - name: jobC
    type: command
    config:
      command: /opt/hadoop-2.7.3/bin/hadoop jar /opt/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.3.jar wordcount /wc/input /wc/output
    dependsOn:
      - jobB

其中dependOn 为 jobB依赖于jobA,jobC依赖于jobB

日志位置为：

/opt/azkaban-3.52.0/azkaban-solo-server/build/install/azkaban-solo-server/local