所用版本azkaban-3.52.0.tar.gz
1.解压
azkaban-3.52.0.tar.gz
# Build without running tests
./gradlew build -x test
# Build and install distributions
./gradlew installDist
4.启动start-solo.sh
cd /opt/azkaban-3.52.0/azkaban-solo-server/build/install/azkaban-solo-server; bin/start-solo.sh
进程为:1790 AzkabanSingleServer
开始简单使用:
1.创建flow20.project文件
azkaban-flow-version: 2.0
2.创建basic.flow文件
nodes:
- name: jobA
type: command
config:
command: echo "This is an echoed text."
3.将以上两个文件打包
Archive.zip
4.登录 hdp1:8081
创建project
导入压缩包
execute进行执行
单词统计案例:
wordcount.flow
nodes:
- name: jobA
type: command
config:
command: /opt/hadoop-2.7.3/bin/hadoop fs -mkdir -p /wc/input
- name: jobB
type: command
config:
command: /opt/hadoop-2.7.3/bin/hadoop fs -put /root/demodata/word.txt /wc/input
dependsOn:
- jobA
- name: jobC
type: command
config:
command: /opt/hadoop-2.7.3/bin/hadoop jar /opt/hadoop-2.7.3/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.3.jar wordcount /wc/input /wc/output
dependsOn:
- jobB
其中dependOn 为 jobB依赖于jobA,jobC依赖于jobB
日志位置为:
/opt/azkaban-3.52.0/azkaban-solo-server/build/install/azkaban-solo-server/local