一、如何查找Spark Home
echo ‘sc.getConf.get(“spark.home”)’ | spark-shell
scala> sc.getConf.get(“spark.home”)
res0: String = /usr/hdp/current/spark2-client
所以Spark Home为: /usr/hdp/current/spark2-client
二、如何查找core-site.xml等配置文件
1、which hadoop(比如结果为:/usr/bin/hadoop)
2、vi /usr/bin/hadoop
3、查看里面的HADOOP_HOME:HADOOP_HOME=${HADOOP_HOME:-/usr/hdp/2.6.1.0-129/hadoop}
4、cd /usr/hdp/2.6.1.0-129/hadoop
5、查看此目录下的config(conf -> /etc/hadoop/2.6.1.0-129/0)