azkaban 3.51.0 安装笔记（三）--------双服模式（two Server）

azkaban 3.51.0 安装笔记（三）--------双服模式（two Server）

环境 centos7 Hadoop+hive+JDK1.8

1.准备数据库

登录MySQL
(1) create database azkaban;
(2) create user 'azkaban'@'%' identified by 'azkaban';
(3) grant all privileges on azkaban.* to 'azkaban'@'%' identified by 'azkaban' with grant option;
(4) flush privileges;
(5) use azkaban;
(6) source create-all-sql-0.1.0-SNAPSHOT.sql所在目录以及文件名（create-all-sql-0.1.0-SNAPSHOT.sql脚本文件路径在笔记（一）中有）

2.将azkaban-web-server和azkaban-exec-server解压至目标文件夹

3.SSL认证----------------可以使用https访问azkaban的web服务
keytool-----安全认证工具
keytool -keystore keystore -alias jetty -genkey -keyalg RSA
这里为了方便记忆，把所有的的密码设置为：azkaban
成功了会多一个keystore的文件

要是失败了重新执行上面的指令即可

4.配置azkaban-web-server里面的conf文件下夹下的azkaban.properties
修改服务名 azkaban.name=CTKJ-Azkaban（可以任意取）
修改时区 default.timezone.id=Asia/Shanghai
修改为true,使用https服务：jetty.use.ssl=true
设置https连接如下

# Azkaban Personalization Settings
azkaban.name=CTKJ-Azkaban
azkaban.label=My Azkaban
azkaban.color=#FF3601
azkaban.default.servlet.path=/index
web.resource.dir=web/
default.timezone.id=Asia/Shanghai 
# Azkaban UserManager class
user.manager.class=azkaban.user.XmlUserManager
user.manager.xml.file=conf/azkaban-users.xml
# Loader for projects
executor.global.properties=conf/global.properties
azkaban.project.dir=projects
# Velocity dev mode
velocity.dev.mode=false
# Azkaban Jetty server properties.
jetty.use.ssl=true
jetty.maxThreads=25
jetty.port=8081

##个人设置1 https登录#############################################################################
jetty.ssl.port=8443
jetty.keystore=/opt/module/azkaban/azkaban-web-server-0.1.0-SNAPSHOT/keystore
jetty.password=azkaban
jetty.keypassword=azkaban
jetty.truststore=/opt/module/azkaban/azkaban-web-server-0.1.0-SNAPSHOT/keystore
jetty.trustpassword=azkaban
#######################################################################################

# Azkaban Executor settings
# mail settings 
mail.sender=
mail.host=
# User facing web server configurations used to construct the user facing server URLs. They are useful when there is a reverse proxy between Azkaban web servers and users.
# enduser -> myazkabanhost:443 -> proxy -> localhost:8081
# when this parameters set then these parameters are used to generate email links.
# if these parameters are not set then jetty.hostname, and jetty.port(if ssl configured jetty.ssl.port) are used.
# azkaban.webserver.external_hostname=myazkabanhost.com
# azkaban.webserver.external_ssl_port=443
# azkaban.webserver.external_port=8081
job.failure.email=
job.success.email=
lockdown.create.projects=false
cache.directory=cache
# JMX stats
jetty.connector.stats=true
executor.connector.stats=true
# Azkaban mysql settings by default. Users should configure their own username and password.
database.type=mysql
mysql.port=3306
mysql.host=slave2
mysql.database=azkaban
mysql.user=azkaban
mysql.password=azkaban
mysql.numconnections=100
#Multiple Executor
azkaban.use.multiple.executors=true
##此处过滤器注释，简化操作
# azkaban.executorselector.filters=StaticRemainingFlowSize,MinimumFreeMemory,CpuStatus
azkaban.executorselector.comparator.NumberOfAssignedFlowComparator=1
azkaban.executorselector.comparator.Memory=1
azkaban.executorselector.comparator.LastDispatched=1
azkaban.executorselector.comparator.CpuUsage=1

##个人设置2#############################################################################
azkaban.activeexecutor.refresh.milisecinterval=10000
azkaban.queueprocessing.enabled=true
#刷新频率
azkaban.activeexecutor.refresh.flowinterval=10
#刷新最大线程
azkaban.executorinfo.refresh.maxThreads=10
#######################################################################################

5.配置azkaban-exec-server里面的conf文件下夹下的azkaban.properties

修改服务名 azkaban.name=CTKJ-Azkaban（可以任意取）
修改时区 default.timezone.id=Asia/Shanghai
修改为自己的：azkaban.webserver.url=https://192.168.137.100:8443（http改为https）
修改为true,使用https服务：jetty.use.ssl=true
修改为MySQL所在的主机：mysql.host=slave2

# Azkaban Personalization Settings
azkaban.name=CTKJ-Azkaban
azkaban.label=My Local Azkaban
azkaban.color=#FF3601
azkaban.default.servlet.path=/index
web.resource.dir=web/
default.timezone.id=Asia/Shanghai
# Azkaban UserManager class
user.manager.class=azkaban.user.XmlUserManager
user.manager.xml.file=conf/azkaban-users.xml
# Loader for projects
executor.global.properties=conf/global.properties
azkaban.project.dir=projects
# Velocity dev mode
velocity.dev.mode=false
# Azkaban Jetty server properties.
jetty.use.ssl=true 
jetty.maxThreads=25
jetty.port=8081

##个人设置1#############################################################################
jetty.keystore=/opt/module/azkaban/azkaban-web-server-0.1.0-SNAPSHOT/keystore
jetty.password=azkaban
jetty.keypassword=azkaban
jetty.truststore=/opt/module/azkaban/azkaban-web-server-0.1.0-SNAPSHOT/keystore
jetty.trustpassword=azkaban
#######################################################################################

# Where the Azkaban web server is located
azkaban.webserver.url=https://192.168.137.100:8443
# mail settings
mail.sender=
mail.host=
# User facing web server configurations used to construct the user facing server URLs. They are useful when there is a reverse proxy between Azkaban web servers and users.
# enduser -> myazkabanhost:443 -> proxy -> localhost:8081
# when this parameters set then these parameters are used to generate email links.
# if these parameters are not set then jetty.hostname, and jetty.port(if ssl configured jetty.ssl.port) are used.
# azkaban.webserver.external_hostname=myazkabanhost.com
# azkaban.webserver.external_ssl_port=443
# azkaban.webserver.external_port=8081
job.failure.email=
job.success.email=
lockdown.create.projects=false
cache.directory=cache
# JMX stats
jetty.connector.stats=true
executor.connector.stats=true
# Azkaban plugin settings
azkaban.jobtype.plugin.dir=plugins/jobtypes
# Azkaban mysql settings by default. Users should configure their own username and password.
database.type=mysql
mysql.port=3306
mysql.host=slave2
mysql.database=azkaban
mysql.user=azkaban
mysql.password=azkaban
mysql.numconnections=100
# Azkaban Executor settings
executor.maxThreads=50
executor.flow.threads=30

6.azkaban-exec-server安装插件
将execute-as-user.c上传到如下目录下（要和自己的安装目录对应）
/opt/module/azkaban/azkaban-exec-server-0.1.0-SNAPSHOT/plugins/jobtypes
由于之前已经安装好了gcc-c++
直接使用指令 (使用gcc编译器编译[ -o ]为目标文件(二进制文件))
gcc execute-as-user.c -o execute-as-user
chown root execute-as-user
chmod 6050 execute-as-user

7.修改azkaban-exec-server里配置文件commonprivate.properties

/opt/module/azkaban/azkaban-exec-server-0.1.0-SNAPSHOT/plugins/jobtypes/commonprivate.properties
添加如下内容

execute.as.user=false
# 关闭内存检查
memCheck.enabled=false
# 本地库位置
azkaban.native.lib=/opt/module/azkaban/azkaban-exec-server-0.1.0-SNAPSHOT/plugins/jobtypes

8.启动服务

1.启动azkaban-exec-server服务
	 cd /opt/module/azkaban/azkaban-exec-server-0.1.0-SNAPSHOT/
     bin/start-exec.sh
2.激活exec-server服务
     curl -G "master:$(<./executor.port)/executor?action=activate" && echo

3.启动web-server服务 
    cd /opt/module/azkaban/azkaban-web-server-0.1.0-SNAPSHOT/
    bin/start-exec.sh

可能存在问题：
exec-server服务可以启动，但是web-server服务无法启动，若是配置没有问题
查看时区后面是否有空格


9.测试web-server和exec-server都启动后网页测试
https://IP:8443