CDH 6.2.0 Zeppelin 安装部署
编译 zeppelin parcels 参考:https://cloud.tencent.com/developer/article/1349543
部署参考 livy安装:https://cloud.tencent.com/developer/article/1349537
补充:重启CM Service monitor,否则安装的livy以及zeppelin的运行状态是无法获取的.
1. 配置zeppelin_java_options :
-verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -XX:+PrintGCApplicationStoppedTime -XX:+PrintTenuringDistribution -Xloggc:./zeppelin-gc.log -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=2 -XX:GCLogFileSize=512M -XX:+UseG1GC -XX:InitiatingHeapOccupancyPercent=70 -XX:+PrintFlagsFinal -XX:+PrintReferenceGC -XX:+UnlockExperimentalVMOptions -XX:-ResizePLAB
2. 创建 zeppelin用户,livy也是需要创建用户 以及相关的日志路径
[root@hzd-t-vbdl-01 ~]# ansible all -m shell -a " adduser zeppelin "
3.创建日志文件
[root@hzd-t-vbdl-01 ~]# ll /var/log/zeppelin/zeppelin-server-hzd-t-vbdl-01.log
[root@hzd-t-vbdl-01 ~]# mkdir -p /alidata1/local/zeppelin/conf
[root@hzd-t-vbdl-01 ~]# chown livy:livy /alidata1/local/zeppelin/conf/
4. 修改端口号:8080 -> 8440
2019-05-31 14:21:54,343 INFO org.eclipse.jetty.server.ServerConnector: Started ServerConnector@4206a205{HTTP/1.1}{0.0.0.0:8440}
[root@hzd-t-vbdl-01 ~]# chmod -R 777 /alidata1/log/zeppelin
[root@hzd-t-vbdl-01 ~]# ll /alidata1/log/zeppelin/zeppelin-zeppelin-hzd-t-vbdl-01
启动日志:
2019-05-31 14:21:47.066774: JAVA_HOME added to path as /usr/java/jdk1.8.0_181-cloudera 2019-05-31 14:21:47.068012: Running command: hdfs dfs -mkdir -p hdfs:///user/zeppelin/conf 2019-05-31 14:21:49.408394: Running command: hdfs dfs -put -f /var/run/cloudera-scm-agent/process/3208-zeppelin-ZEPPELIN_SERVER/zeppelin-conf/interpreter.json hdfs:///user/zeppelin/conf 2019-05-31 14:21:51.699608: Running command: hdfs dfs -mkdir -p file:///alidata1/local/zeppelin/data/notebook 2019-05-31 14:21:53.146416: Running command: /opt/cloudera/parcels/ZEPPELIN-0.8.0/bin/zeppelin-daemon.sh --config /var/run/cloudera-scm-agent/process/3208-zeppelin-ZEPPELIN_SERVER/zeppelin-conf start 2019-05-31 14:21:55.176103: Running command: tail --pid=$( cat /alidata1/log/zeppelin/run/zeppelin-zeppelin-*.pid) -f /dev/null