maven依赖 spark sql_maven-spark sql 1.5构建失败

在Ubuntu 14.04 LTS上安装Spark 1.5后,遇到maven构建Spark SQL模块时的错误。错误提示为无法加载'WebUI.class',可能是因为org.eclipse.jetty缺失或版本不兼容。尝试使用-Ylog-classpath参数进行全量重建,但问题未得到解决。解决方案可能涉及检查和更新依赖关系,或者调整JAVA_HOME, SCALA_HOME, SPARK_HOME和MAVEN_OPTS等环境变量。" 80778037,7798187,Scrapy爬虫过滤外站请求问题及解决方案,"['Python', '网络爬虫', 'Scrapy框架', '网页抓取']
摘要由CSDN通过智能技术生成

我已经在ubuntu 14.04lts上安装了spark 1.5。

[error] missing or invalid dependency detected while loading class file 'WebUI.class'.

[error] Could not access term eclipse in package org,

[error] because it (or its dependencies) are missing. Check your build definition for

[error] missing or conflicting dependencies. (Re-run with `-Ylog-classpath` to see the problematic classpath.)

[error] A full rebuild may help if 'WebUI.class' was compiled against an incompatible version of org.

[error] missing or invalid dependency detected while loading class file 'WebUI.class'.

[error] Could not access term jetty in value org.eclipse,

[error] because it (or its dependencies) are missing. Check your build definition for

[error] missing or conflicting dependencies. (Re-run with `-Ylog-classpath` to see the problematic classpath.)

[error] A full rebuild may help if 'WebUI.class' was compiled against an incompatible version of org.eclipse.

[warn] 22 warnings found

[error] two errors found

[error] Compile failed at Sep 18, 2015 6:09:38 PM [17.330s]

[INFO] ------------------------------------------------------------------------

[INFO] Reactor Summary:

[INFO]

[INFO] Spark Project Parent POM ........................... SUCCESS [ 6.723 s]

[INFO] Spark Project Core ................................. SUCCESS [03:07 min]

...

[INFO] Spark Project Catalyst ............................. SUCCESS [ 58.166 s]

[INFO] Spark Project SQL .................................. FAILURE [ 19.912 s]

[INFO] Spark Project Hive ................................. SKIPPED

[INFO] Spark Project Unsafe ............................... SKIPPED

...

[INFO] ------------------------------------------------------------------------

[INFO] BUILD FAILURE

[INFO] ------------------------------------------------------------------------

下面是file.bashrc中的my env变量

export JAVA_HOME=/usr/lib/jvm/java-1.7.0-openjdk-amd64

export SCALA_HOME=/usr/local/src/scala/scala-2.11.7

export PATH=$SCALA_HOME/bin:$PATH

export PATH=/home/ubuntu/apache-maven-3.3.3/bin:$PATH

export SPARK_HOME=/home/ubuntu/spark-1.5.0

export MAVEN_OPTS="-Xmx2g -XX:MaxPermSize=512M -XX:ReservedCodeCacheSize=512m"

更新:尝试使用-ylog类路径运行,但不起作用:

Unable to parse command line options: Unrecognized option: -Ylog-classpath

评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值