exec不同文件l怎么汇总_Spark开发常见问题汇总

Spark常见问题汇总

1. 提交时出现Container      exited with a non-zero exit code 13

解决方案:去掉代码中的setMaster(XX),因为你在命令行中指定的运行模式会和代码中的有所冲突

2.     ClassNotFoundException(IDEA方式下)

解决方案:请在你的项目中添加maven的编译插件(红标处请修改为你的相应类)

net.alchim31.maven                       scala-maven-plugin                       3.2.2                       org.apache.maven.plugins                       maven-compiler-plugin                       3.5.1                   net.alchim31.maven                   scala-maven-plugin                           scala-compile-first                           process-resources                               add-source                               compile                           scala-test-compile                           process-test-resources                               testCompile                   org.apache.maven.plugins                   maven-compiler-plugin                           compile                               compile                   org.apache.maven.plugins                   maven-shade-plugin                   2.4.3                           package                               shade                                       *:*                                           META-INF/*.SF                                           META-INF/*.DSA                                           META-INF/*.RSA

3. 程序没跑起来?请按照如下步骤进行打包(用于IDEA)

1. 1. 先clean

   2. 再package

   3. <