坑点:
CDH的spark home其实在 /opt/cloudera/parcels/SPARK2-2.1.0.cloudera2-1.cdh5.7.0.p0.171658/lib/spark2/bin
一定要找那个有spark-class.sh文件的目录。spark-submit.sh其实调用的是spark-class.sh.
配置SPARK_HOME到zeppelin-env.sh
对于Kerberos启用的集群,要生成keytab,并配置应用:
com.fasterxml.jackson.databind.JsonMappingException: Incompatible Jackson version: 2.8.11-1:
jackson版本问题,把Spark lib里的jar移过来
rm zeppelin/lib/jackson-*
cp $spark_home/jars/jackson-* zeppelin/lib/
YARN资源池启用:
配置:spark.yarn.queue
spark.submit.deployMode:
配置:cluster
让笔记默认为私密的: