1 报错信息
Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/spark/sql/SparkSession$
at Demo1_QuickStart$.main(Demo1_QuickStart.scala:7)
at Demo1_QuickStart.main(Demo1_QuickStart.scala)
Caused by: java.lang.ClassNotFoundException: org.apache.spark.sql.SparkSession$
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 2 more
Process finished with exit code 1
2 原因分析
<dependency>
<groupId>org.apache.spark</groupId>
<artifactId>spark-sql_2.10</artifactId>
<version>${spark.version}</version>
<!-- <scope>provided</scope> -->
</dependency>
自己在pom文件中加入了
<scope>provided</scope>
此标签表示编译环境可用,运行时则不可用,主要是在 打包时不将这些依赖打进来,因为服务器上有,以免包过大
解决方案:本地运行时注销掉<scope>provided</scope>如上图所示。