报错信息:
Exception in thread “main” java.lang.NoClassDefFoundError: org/apache/hadoop/fs/FSDataInputStream
at org.apache.spark.SparkConf.loadFromSystemProperties(SparkConf.scala:73)
具体报错信息:
查看一下pom.xml文件中,是不是存在<scope>provided</scope>,去掉<scope>provided</scope>试一下
<dependency> <dependency>
<groupId>org.apache.hadoop</groupId> <groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-common</artifactId> ===》 <artifactId>hadoop-common</artifactId>
<version>2.5.0-cdh5.2.0</version> <version>2.5.0-cdh5.2.0</version>
<scope>provided</scope> </dependency>
</dependency>