在jupyther里面执行sc = SparkContext(conf=conf),出现:
Spark submit fails: No such file or directory: '/opt/spark/python/pyspark/./bin/spark-submit'
解决办法:
os.environ['SPARK_HOME'] = '/export/servre/spark'
填写集群的spark安装地址
在jupyther里面执行sc = SparkContext(conf=conf),出现:
Spark submit fails: No such file or directory: '/opt/spark/python/pyspark/./bin/spark-submit'
解决办法:
os.environ['SPARK_HOME'] = '/export/servre/spark'
填写集群的spark安装地址