搭建好spark 环境之后,按照网上说的用IdeaIl 运行,会报错
Exception in thread "main" org.apache.spark.SparkException: A master URL must be set
in your configuration
at org.apache.spark.SparkContext.<init>(SparkContext.scala:166)
at org.apache.spark.examples.mllib.BinaryClassification$.run(BinaryClassification
解决方案:
在例子代码中,调整
val conf = new SparkConf().setAppName("Spark Pi")
调整成
val conf = new SparkConf().setMaster("spark://10.163.209.123:7077").setAppName("Spark Pi")
其中setmaster中是 spark://master地址:端口