Spark2.4.5 MLIB源码安装踩坑记java.lang.ClassNotFoundException: org.eclipse.jetty.server.handler.ContextHand

最新推荐文章于 2022-06-01 14:39:11 发布

大锤爱编程

最新推荐文章于 2022-06-01 14:39:11 发布

阅读量642

点赞数

分类专栏：大数据文章标签：大数据

本文链接：https://blog.csdn.net/alike_u/article/details/117704509

版权

大数据专栏收录该内容

14 篇文章 0 订阅

订阅专栏

一、坑是啥

特别奇怪的是，我下载下来的源代码在idea中直接编译是没有问题的。但在源码目录里面加了一个包，写自己的代码时就出现了包找不到的问题。就是说jetty的包，找不到，怎么找不到也不说。

Exception in thread "main" java.lang.NoClassDefFoundError: org/eclipse/jetty/server/handler/ContextHandler
	at org.apache.spark.ui.SparkUI$.create(SparkUI.scala:178)
	at org.apache.spark.SparkContext.<init>(SparkContext.scala:444)
	at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520)
	at org.apache.spark.sql.SparkSession$Builder.$anonfun$getOrCreate$5(SparkSession.scala:935)
	at scala.Option.getOrElse(Option.scala:189)
	at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926)
	at com.hammer.code.Test$.main(Test.scala:11)
	at com.hammer.code.Test.main(Test.scala)
Caused by: java.lang.ClassNotFoundException: org.eclipse.jetty.server.handler.ContextHandler
	at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
	... 8 more

二、问题的解决

在pom文件中增加如下依赖，整个项目就可以完成编译。

  <dependency>
      <groupId>org.eclipse.jetty</groupId>
      <artifactId>jetty-plus</artifactId>
      <scope>compile</scope>
    </dependency>
    <dependency>
      <groupId>org.eclipse.jetty</groupId>
      <artifactId>jetty-security</artifactId>
      <scope>compile</scope>
    </dependency>
    <dependency>
      <groupId>org.eclipse.jetty</groupId>
      <artifactId>jetty-util</artifactId>
      <scope>compile</scope>
    </dependency>
    <dependency>
      <groupId>org.eclipse.jetty</groupId>
      <artifactId>jetty-server</artifactId>
      <scope>compile</scope>
    </dependency>
    <dependency>
      <groupId>org.eclipse.jetty</groupId>
      <artifactId>jetty-http</artifactId>
      <scope>compile</scope>
    </dependency>
    <dependency>
      <groupId>org.eclipse.jetty</groupId>
      <artifactId>jetty-continuation</artifactId>
      <scope>compile</scope>
    </dependency>
    <dependency>
      <groupId>org.eclipse.jetty</groupId>
      <artifactId>jetty-servlet</artifactId>
      <scope>compile</scope>
    </dependency>
    <dependency>
      <groupId>org.eclipse.jetty</groupId>
      <artifactId>jetty-proxy</artifactId>
      <scope>compile</scope>
    </dependency>
    <dependency>
      <groupId>org.eclipse.jetty</groupId>
      <artifactId>jetty-client</artifactId>
      <scope>compile</scope>
    </dependency>
    <dependency>
      <groupId>org.eclipse.jetty</groupId>
      <artifactId>jetty-servlets</artifactId>
      <scope>compile</scope>
    </dependency>
    <dependency>
      <groupId>javax.servlet</groupId>
      <artifactId>javax.servlet-api</artifactId>
      <version>${javaxservlet.version}</version>
    </dependency>