准备工作
准备azkaban的安装包
- 直接下载azkaban的压缩包,上传解压
- 使用git从官网下载源码,编译
配置mysql
-》为azkaban创建用户、数据库、设置权限等
CREATE DATABASE azkaban;
CREATE USER 'azkaban'@'%' IDENTIFIED BY 'azkaban';
GRANT SELECT,INSERT,UPDATE,DELETE ON azkaban.* to 'azkaban'@'%' WITH GRANT OPTION;
flush privileges;
select user,host from mysql.user;
sudo service mysqld restart
-》执行相关的SQL创建对应表(三个sql文件是安装包解压后的sql包中包含的)
source create-all-sql-0.1.0-SNAPSHOT.sql
source update.active_executing_flows.3.0.sql;
source update.execution_flows.3.0.sql;
配置Azkaban Web Server
进入到web目录下、生成认证密钥
keytool -keystore keystore -alias jetty -genkey -keyalg RSA
密码输入:123456
Enter keystore password:
Re-enter new password:
What is your first and last name?
[Unknown]: zhangsan
What is the name of your organizational unit?
[Unknown]: zhangsan
What is the name of your organization?
[Unknown]: zhangsan
What is the name of your City or Locality?
[Unknown]: hangzhou
What is the name of your State or Province?
[Unknown]: zhejiang
What is the two-letter country code for this unit?
[Unknown]: CN
Is CN=huadian, OU=huadian, O=huadian, L=zhejiang, ST=jiaxing, C=CN correct?
[no]: yes
Enter key password for <jetty>
(RETURN if same as keystore password):
Re-enter new password:
修改web配置文件
conf/azkaban.properties
default.timezone.id=Asia/Shanghai
mysql.host=xxxxxxx主机名
默认开启了SSL,访问时必须通过https来访问8443端口
如果不想使用https,可以关闭ssl
jetty.ssl.use=false;
jetty.password=123456
jetty.keypassword=123456
jetty.trustpassword=123456
添加log4j配置
log4j.rootLogger=INFO,C
log4j.appender.C=org.apache.log4j.ConsoleAppender
log4j.appender.C.Target=System.err
log4j.appender.C.layout=org.apache.log4j.PatternLayout
log4j.appender.C.layout.ConversionPattern=%d{yyyy-MM-dd HH:mm:ss} %-5p %c{1}:%L - %m%n
配置日志相关
- 新建
添加log4j配置
log4j.rootLogger=INFO,C
log4j.appender.C=org.apache.log4j.ConsoleAppender
log4j.appender.C.Target=System.err
log4j.appender.C.layout=org.apache.log4j.PatternLayout
log4j.appender.C.layout.ConversionPattern=%d{yyyy-MM-dd HH:mm:ss} %-5p %c{1}:%L - %m%n
添加日志转换Jar包
将slf4j-log4j12-1.6.6.jar上传lib目标下
-》配置execute
进入到/azkaban-exec-server-0.1.0-SNAPSHOT下面
修改配置文件:conf/azkaban.properties
default.timezone.id=Asia/Shanghai
mysql.port=3306
mysql.host=bigdata-hpsk01.huadian.com
mysql.database=azkaban
关闭内存检查
vi plugins/jobtypes/commonprivate.properties
memCheck.enabled=false
-》启动登录
启动web server
bin/azkaban-web-start.sh
启动executor
bin/azkaban-executor-start.sh
登录
https://bigdata-hpsk01.huadian.com:8443
azkaban/azkaban