大数据学习_azkaban启动及报错解决

节点安排

host	服务
centos7-1	exec-server
centos7-2	web-server
centos7-3	mysql,exec-server

启动

## 启动顺序：hdfs yarn zookeeper 1/3节点上的azkaban-exec 最后是3节点上azkaban-web
# centos7-1 
start-dfs.sh
sh /root/shell/zk.sh start
start-hbase.sh
cd /opt/lagou/servers/azkaban/azkaban-exec-server-0.1.0-SNAPSHOT
bin/start-exec.sh

# centos7-2 
cd /opt/lagou/servers/azkaban/azkaban-web-server-0.1.0-SNAPSHOT
bin/start-web.sh

# centos7-3
start-yarn.sh
cd /opt/lagou/servers/azkaban/azkaban-exec-server-0.1.0-SNAPSHOT
bin/start-exec.sh

报错解决

1. web节点上AzkabanWebServer消失

# 查看日志发现 
cat webServerLog_2021-03-04+11\:06\:09.out

1) Error injecting constructor, azkaban.executor.ExecutorManagerException: No active executor found
  at azkaban.executor.ExecutorManager.<init>(ExecutorManager.java:125)
  at azkaban.executor.ExecutorManager.class(ExecutorManager.java:78)

两种解决办法

# 1.在1/3节点执行
curl -G "centos7-1:$(<./executor.port)/executor?action=activate" && echo
curl -G "centos7-3:$(<./executor.port)/executor?action=activate" && echo

# 2.进入mysql azkaban数据库 修改executors 表格中的action值 由0改为1
update azkaban.executors set active=1;
mysql> select * from executors;
+----+-----------+-------+--------+
| id | host      | port  | active |
+----+-----------+-------+--------+
|  3 | centos7-3 | 12321 |      0 |
|  4 | centos7-1 | 12321 |      0 |
+----+-----------+-------+--------+
2 rows in set (0.01 sec)
mysql> select * from executors;
+----+-----------+-------+--------+
| id | host      | port  | active |
+----+-----------+-------+--------+
|  3 | centos7-3 | 12321 |      1 |
|  4 | centos7-1 | 12321 |      1 |
+----+-----------+-------+--------+
2 rows in set (0.01 sec)

2. 执行问题

在编写job 或者sh脚本时，切记将文字格式由windows调成Unix，否则交给azkaban执行时，会各种出问题。