CM分发安装部署Zeppelin后无法启动

CDH 6.2.0 Zeppelin 安装部署

编译 zeppelin parcels 参考:https://cloud.tencent.com/developer/article/1349543

部署参考 livy安装:https://cloud.tencent.com/developer/article/1349537

补充:重启CM Service monitor,否则安装的livy以及zeppelin的运行状态是无法获取的.

 

1. 配置zeppelin_java_options :

-verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -XX:+PrintGCApplicationStoppedTime  -XX:+PrintTenuringDistribution -Xloggc:./zeppelin-gc.log -XX:+UseGCLogFileRotation  -XX:NumberOfGCLogFiles=2 -XX:GCLogFileSize=512M -XX:+UseG1GC  -XX:InitiatingHeapOccupancyPercent=70 -XX:+PrintFlagsFinal -XX:+PrintReferenceGC  -XX:+UnlockExperimentalVMOptions -XX:-ResizePLAB

 

2. 创建 zeppelin用户,livy也是需要创建用户 以及相关的日志路径

[root@hzd-t-vbdl-01 ~]# ansible all -m shell -a " adduser zeppelin  "

 

3.创建日志文件

[root@hzd-t-vbdl-01 ~]# ll /var/log/zeppelin/zeppelin-server-hzd-t-vbdl-01.log

[root@hzd-t-vbdl-01 ~]# mkdir  -p /alidata1/local/zeppelin/conf

[root@hzd-t-vbdl-01 ~]# chown livy:livy /alidata1/local/zeppelin/conf/

 

4. 修改端口号:8080 -> 8440

2019-05-31 14:21:54,343 INFO org.eclipse.jetty.server.ServerConnector: Started ServerConnector@4206a205{HTTP/1.1}{0.0.0.0:8440}

[root@hzd-t-vbdl-01 ~]# chmod -R 777 /alidata1/log/zeppelin

[root@hzd-t-vbdl-01 ~]# ll  /alidata1/log/zeppelin/zeppelin-zeppelin-hzd-t-vbdl-01

 

启动日志:

2019-05-31 14:21:47.066774: JAVA_HOME added to path as /usr/java/jdk1.8.0_181-cloudera
2019-05-31 14:21:47.068012: Running command: hdfs dfs -mkdir -p hdfs:///user/zeppelin/conf
2019-05-31 14:21:49.408394: Running command: hdfs dfs -put -f /var/run/cloudera-scm-agent/process/3208-zeppelin-ZEPPELIN_SERVER/zeppelin-conf/interpreter.json hdfs:///user/zeppelin/conf
2019-05-31 14:21:51.699608: Running command: hdfs dfs -mkdir -p file:///alidata1/local/zeppelin/data/notebook
2019-05-31 14:21:53.146416: Running command: /opt/cloudera/parcels/ZEPPELIN-0.8.0/bin/zeppelin-daemon.sh --config /var/run/cloudera-scm-agent/process/3208-zeppelin-ZEPPELIN_SERVER/zeppelin-conf start
2019-05-31 14:21:55.176103: Running command: tail --pid=$( cat /alidata1/log/zeppelin/run/zeppelin-zeppelin-*.pid) -f /dev/null