Azkaban Install and Schedule Job

1.git clone and buid
[root@sht-sgmhadoopdn-04 app]# git clone https://github.com/azkaban/azkaban.git
[root@sht-sgmhadoopdn-04 app]# cd azkaban
[root@sht-sgmhadoopdn-04 azkaban]# ./gradlew build
[root@sht-sgmhadoopdn-04 azkaban]# cd azkaban-solo-server/build/distributions/
[root@sht-sgmhadoopdn-04 distributions]# ll
total 46372
-rw-r--r-- 1 root root 23678999 Apr 21 14:17 azkaban-solo-server-3.21.0-6-g102226a.tar.gz
-rw-r--r-- 1 root root 23800311 Apr 21 14:17 azkaban-solo-server-3.21.0-6-g102226a.zip
[root@sht-sgmhadoopdn-04 distributions]# cp azkaban-solo-server-3.21.0-6-g102226a.tar.gz ~/learnproject/app/

2.tar and modify parameter
[root@sht-sgmhadoopdn-04 distributions]# cd ~/learnproject/app/
[root@sht-sgmhadoopdn-04 app]# tar -xzvf azkaban-solo-server-3.21.0-6-g102226a.tar.gz
[root@sht-sgmhadoopdn-04 app]# mv azkaban-solo-server-3.21.0-6-g102226a azkaban-3.21.0
[root@sht-sgmhadoopdn-04 app]# cd azkaban-3.21.0

[root@sht-sgmhadoopdn-04 azkaban-3.21.0]# cd conf
[root@sht-sgmhadoopdn-04 conf]# ll
total 8
-rw-r--r-- 1 root root 941 Apr 21 14:08 azkaban.properties
-rw-r--r-- 1 root root 265 Apr 21 14:08 azkaban-users.xml
-rw-r--r-- 1 root root   0 Apr 21 14:08 global.properties
[root@sht-sgmhadoopdn-04 conf]# vi azkaban.properties
default.timezone.id=Asia/Shanghai

3.start and open
[root@sht-sgmhadoopdn-04 azkaban-3.21.0]# ./bin/azkaban-solo-start.sh 
...........
2017/04/21 14:26:13.219 +0800 INFO [log] [Azkaban] jetty-6.1.26
2017/04/21 14:26:13.221 +0800 INFO [log] [Azkaban] Started SocketConnector@0.0.0.0:12321
2017/04/21 14:26:13.226 +0800 INFO [AzkabanExecutorServer] [Azkaban] Started Executor Server on sht-sgmhadoopdn-04:12321
2017/04/21 14:26:13.226 +0800 INFO [AzkabanWebServer] [Azkaban] Azkaban Exec Server started...

open web: http://sht-sgmhadoopdn-04:8081/    azkaban/azkaban


4.create project:loganalysis 

5.create the file hour_logtype_count.job 

点击(此处)折叠或打开

1. type=command
   
2. # 执行sh脚本，建议这样做，后期只需维护脚本就行了，azkaban定义工作流程
   
3. command=ssh hive@sht-sgmhadoopnn-02 "/tmp/hour_logtype_count.sh"

6.zip the file hour_logtype_count.job  to hour_logtype_count.zip

7.click Upload, select hour_logtype_count.zip

8.set schedule time: 0 5 * ? * *

9.run the hour_logtype_count

来自 “ ITPUB博客 ” ，链接：http://blog.itpub.net/30089851/viewspace-2137767/，如需转载，请注明出处，否则将追究法律责任。

转载于:http://blog.itpub.net/30089851/viewspace-2137767/