azkaban部署

1上传安装包

[root@master01 azkaban]# pwd
/usr/local/azkaban
[root@master01 azkaban]# ll
total 22616
-rw-r--r-- 1 root root 11157302 Jun 12 14:24 azkaban-executor-server-2.5.0.tar.gz
-rw-r--r-- 1 root root     1928 Jun 12 14:24 azkaban-sql-script-2.5.0.tar.gz
-rw-r--r-- 1 root root 11989669 Jun 12 14:24 azkaban-web-server-2.5.0.tar.gz

2解压文件

1解压azkaban-web-server-2.5.0.tar.gz ,并重新命名 server 
2解压azkaban-executor-server-2.5.0.tar.gz 命名executor
3azkaban 脚本导入 
[root@master01 azkaban]# tar -zxvf azkaban-web-server-2.5.0.tar.gz
[root@master01 azkaban]#  tar -zxvf azkaban-executor-server-2.5.0.tar.gz
[root@master01 azkaban]#  tar -zxvf azkaban-sql-script-2.5.0.tar.gz
[root@master01 azkaban]# mv azkaban-web-2.5.0/ server
[root@master01 azkaban]#  mv azkaban-executor-2.5.0 executor
[root@master01 azkaban]# ll
total 16
drwxr-xr-x 2 root root 4096 Jun 12 14:26 azkaban-2.5.0
drwxr-xr-x 7 root root 4096 Jun 12 14:25 executor
drwxr-xr-x 8 root root 4096 Jun 12 14:25 server

3azkaban 脚本导入

1创建数据库
[root@master01 azkaban]# mysql -uroot -p
Enter password: 

mysql> create database azkaban; 
mysql> use azkaban;
mysql> source /usr/local/azkaban/azkaban-2.5.0/create-all-sql-2.5.0.sql; 
Query OK, 0 rows affected (0.06 sec)

Query OK, 0 rows affected (0.04 sec)

Query OK, 0 rows affected (0.04 sec)

表示执行成功

4创建 SSL 配置(https)

命令: keytool -keystore keystore -alias jetty -genkey -keyalg RSA

运行此命令后,会提示输入当前生成 keystor 的密码及相应信息,输入的密码请劳记, 信息如下:

输入keystore密码:

再次输入新密码:

您的名字与姓氏是什么?

[Unknown]:

您的组织单位名称是什么?

[Unknown]:

您的组织名称是什么?

[Unknown]:

您所在的城市或区域名称是什么?

[Unknown]:

您所在的州或省份名称是什么?

[Unknown]:

该单位的两字母国家代码是什么

[Unknown]: CN

CN=Unknown, OU=Unknown, O=Unknown, L=Unknown, ST=Unknown, C=CN 正确吗?

[否]: y 输入的主密码

    (如果和 keystore 密码相同,按回车):  再次输入新密码: 

完成上述工作后,将在当前目录生成 keystore 证书文件,将 keystore 拷贝

到 azkaban web服务器根目录中.如:cp keystore azkaban/webserver

[root@master01 azkaban]# keytool -keystore keystore -alias jetty -genkey -keyalg RSA 
Enter keystore password:  
Re-enter new password: 
They don't match. Try again
Enter keystore password:  
Re-enter new password: 
They don't match. Try again
Enter keystore password:  
Re-enter new password: 
What is your first and last name?
  [Unknown]:  he^H
What is the name of your organizational unit?
  [Unknown]:  hg
What is the name of your organization?
  [Unknown]:  hg
What is the name of your City or Locality?
  [Unknown]:  shanghai
What is the name of your State or Province?
  [Unknown]:  shanghai
What is the two-letter country code for this unit?
  [Unknown]:  shanghai
Is CN=h, OU=hg, O=hg, L=shanghai, ST=shanghai, C=shanghai correct?
  [no]:  y

Enter key password for <jetty>
	(RETURN if same as keystore password):  
Re-enter new password: 

Warning:
The JKS keystore uses a proprietary format. It is recommended to migrate to PKCS12 which is an industry standard format using "keytool -importkeystore -srckeystore keystore -destkeystore keystore -deststoretype pkcs12".
拷贝文件:
[root@master01 azkaban]# cp keystore server/

5配置时间服务器

注:先配置好服务器节点上的时区

先生成时区配置文件Asia/Shanghai,用交互式命令 tzselect 即可 拷贝该时区文件,覆盖系统本地时区配置

cp /usr/share/zoneinfo/Asia/Shanghai /etc/localtime

[root@master01 azkaban]# tzselect
Please identify a location so that time zone rules can be set correctly.
Please select a continent or ocean.
 1) Africa
 2) Americas
 3) Antarctica
 4) Arctic Ocean
 5) Asia
 6) Atlantic Ocean
 7) Australia
 8) Europe
 9) Indian Ocean
10) Pacific Ocean
11) none - I want to specify the time zone using the Posix TZ format.
#? 5
Please select a country.
 1) Afghanistan		  18) Israel		    35) Palestine
 2) Armenia		  19) Japan		    36) Philippines
 3) Azerbaijan		  20) Jordan		    37) Qatar
 4) Bahrain		  21) Kazakhstan	    38) Russia
 5) Bangladesh		  22) Korea (North)	    39) Saudi Arabia
 6) Bhutan		  23) Korea (South)	    40) Singapore
 7) Brunei		  24) Kuwait		    41) Sri Lanka
 8) Cambodia		  25) Kyrgyzstan	    42) Syria
 9) China		  26) Laos		    43) Taiwan
10) Cyprus		  27) Lebanon		    44) Tajikistan
11) East Timor		  28) Macau		    45) Thailand
12) Georgia		  29) Malaysia		    46) Turkmenistan
13) Hong Kong		  30) Mongolia		    47) United Arab Emirates
14) India		  31) Myanmar (Burma)	    48) Uzbekistan
15) Indonesia		  32) Nepal		    49) Vietnam
16) Iran		  33) Oman		    50) Yemen
17) Iraq		  34) Pakistan
#? 9
Please select one of the following time zone regions.
1) Beijing Time
2) Xinjiang Time
#? 1

The following information has been given:

	China
	Beijing Time

Therefore TZ='Asia/Shanghai' will be used.
Local time is now:	Wed Jun 12 18:46:48 CST 2019.
Universal Time is now:	Wed Jun 12 10:46:48 UTC 2019.
Is the above information OK?
1) Yes
2) No
#? 1

You can make this change permanent for yourself by appending the line
	TZ='Asia/Shanghai'; export TZ
to the file '.profile' in your home directory; then log out and log in again.

Here is that TZ value again, this time on standard output so that you
can use the /usr/bin/tzselect command in shell scripts:
Asia/Shanghai
[root@master01 azkaban]# 
[root@master01 azkaban]# cp /usr/share/zoneinfo/Asia/Shanghai /etc/localtime 

6修改azkaban.properties文件

[root@master01 conf]# pwd
/usr/local/azkaban/server/conf
[root@master01 conf]# ll
total 8
-rw-r--r-- 1 root root 1022 Apr 22  2014 azkaban.properties
-rw-r--r-- 1 root root  266 Apr 22  2014 azkaban-users.xml
[root@master01 conf]# 
#Azkaban Personalization Settings
azkaban.name=Test
azkaban.label=My Local Azkaban
azkaban.color=#FF3601
azkaban.default.servlet.path=/index
web.resource.dir=web/
default.timezone.id=Asia/Shanghai

#Azkaban UserManager class
user.manager.class=azkaban.user.XmlUserManager
user.manager.xml.file=conf/azkaban-users.xml

#Loader for projects
executor.global.properties=conf/global.properties
azkaban.project.dir=projects

database.type=mysql
mysql.port=3306
mysql.host=master01
mysql.database=azkaban
# 修改数据库用户名,密码
mysql.user=XXX
mysql.password=XXX
mysql.numconnections=100

# Velocity dev mode
velocity.dev.mode=false

# Azkaban Jetty server properties.
jetty.maxThreads=25
jetty.ssl.port=8443
jetty.port=8081
jetty.keystore=keystore

#修改jetty密码
jetty.password=XXX
jetty.keypassword=XXX
jetty.truststore=keystore
jetty.trustpassword=XXX

# Azkaban Executor settings
executor.port=12321

# mail settings
mail.sender=
mail.host=
job.failure.email=
job.success.email=

lockdown.create.projects=false

cache.directory=cache

azkaban 执行服务器配置进入执行服务器安装目录conf,修改azkaban.properties

[root@master01 conf]# pwd
/usr/local/azkaban/executor/conf
[root@master01 conf]# ll
total 8
-rw-r--r-- 1 root root  55 Apr 22  2014 azkaban.private.properties
-rw-r--r-- 1 root root 469 Apr 22  2014 azkaban.properties
-rw-r--r-- 1 root root   0 Apr 22  2014 global.properties
[root@master01 conf]# 
[root@master01 conf]# vi azkaban.properties 
#Azkaban
#1修改时区
default.timezone.id=Asia/Shanghai

# Azkaban JobTypes Plugins
azkaban.jobtype.plugin.dir=plugins/jobtypes

#Loader for projects
executor.global.properties=conf/global.properties
azkaban.project.dir=projects

database.type=mysql
mysql.port=3306
#2修改数据库
mysql.host=master01
mysql.database=azkaban
mysql.user=XXX
mysql.password=XXX
mysql.numconnections=100

# Azkaban Executor settings
executor.maxThreads=50
executor.port=12321
executor.flow.threads=30

7增加用户权限

[root@master01 conf]# pwd
/usr/local/azkaban/server/conf
[root@master01 conf]# 
[root@master01 conf]# vi azkaban-users.xml 
<azkaban-users>
	<user username="azkaban" password="azkaban" roles="admin" groups="azkaban" />
	<user username="metrics" password="metrics" roles="metrics"/>
	   <user username="admin" password="admin" roles="admin,metrics" /> 
	<role name="admin" permissions="ADMIN" />
	<role name="metrics" permissions="METRICS"/>
</azkaban-users>

8启动

web服务器在azkaban web服务器目录下执行启动命令

bin/azkaban-web-start.sh

注:在web服务器根目录运行执行服务器在执行服务器目录下执行启动命令

bin/azkaban-executor-start.sh ./

注:只能要执行服务器根目录运行启动完成后,在浏览器(建议使用谷歌浏览器)中输入https://服务器IP地址:8443 ,即可访问azkaban服务了.在登录中输入刚才新的户用名及密码,点击login.

启动服务端:
[root@master01 server]# pwd
/usr/local/azkaban/server
[root@master01 server]# bin/azkaban-web-start.sh 
启动executor端
[root@master01 executor]# pwd
/usr/local/azkaban/executor
[root@master01 executor]# bin/azkaban-executor-start.sh 
访问页面:
https://master01:8443

错误:

2019/06/12 22:08:37.383 +0800 INFO [JdbcTriggerLoader] [Azkaban] Loading all triggers from db.
2019/06/12 22:08:37.450 +0800 INFO [JdbcTriggerLoader] [Azkaban] Loaded 0 triggers.
2019/06/12 22:08:37.451 +0800 INFO [log] [Azkaban] jetty-6.1.26
2019/06/12 22:08:37.882 +0800 INFO [log] [Azkaban] Started SslSocketConnector@0.0.0.0:8443
2019/06/12 22:08:37.882 +0800 INFO [AzkabanWebServer] [Azkaban] Server running on ssl port 8443.
2019/06/12 22:09:41.606 +0800 WARN [log] [Azkaban] EXCEPTION 
javax.net.ssl.SSLException: Unrecognized SSL message, plaintext connection?
	at sun.security.ssl.InputRecord.handleUnknownRecord(InputRecord.java:710)
	at sun.security.ssl.InputRecord.read(InputRecord.java:527)
	at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:983)
	at sun.security.ssl.SSLSocketImpl.performInitialHandshake(SSLSocketImpl.java:1385)
	at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1413)
	at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1397)
	at org.mortbay.jetty.security.SslSocketConnector$SslConnection.run(SslSocketConnector.java:708)
	at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)

该错误是因为浏览器的原因造成
原来访问地址为http://master01:8443 现在访问地址https://master01:8443
https://10.10.109.198:8443

评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值