NoClassDefFoundError: org/apache/spark/api/java/function/PairFunction

最新推荐文章于 2024-03-04 10:52:40 发布

微电子学与固体电子学-俞驰

最新推荐文章于 2024-03-04 10:52:40 发布

阅读量881

点赞数

分类专栏： Scala与Spark

本文链接：https://blog.csdn.net/appleyuchi/article/details/107761203

版权

Scala与Spark 专栏收录该内容

119 篇文章 5 订阅

订阅专栏

Error: A JNI error has occurred, please check your installation and try again
Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/spark/api/java/function/PairFunction
   at java.lang.Class.getDeclaredMethods0(Native Method)
   at java.lang.Class.privateGetDeclaredMethods(Class.java:2701)
   at java.lang.Class.privateGetMethodRecursive(Class.java:3048)
   at java.lang.Class.getMethod0(Class.java:3018)
   at java.lang.Class.getMethod(Class.java:1784)
   at sun.launcher.LauncherHelper.validateMainClass(LauncherHelper.java:544)
   at sun.launcher.LauncherHelper.checkAndLoadMain(LauncherHelper.java:526)
Caused by: java.lang.ClassNotFoundException: org.apache.spark.api.java.function.PairFunction
   at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
   at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
   at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335)
   at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
   ... 7 more

检查了pom.xml中，确认有

<dependency>
  <groupId>org.apache.spark</groupId>
  <artifactId>spark-core_2.12</artifactId>
  <version>${spark.version}</version>
  <scope>provided</scope>
</dependency>

以后.

Run->Edit Configurations，然后把下面的Include dependencies with "Provided" scope勾选