![](https://img-blog.csdnimg.cn/20201014180756919.png?x-oss-process=image/resize,m_fixed,h_64,w_64)
Spark
兔帮大人
平台架构师,全线工程师
展开
-
spark报错:Invalid signature file digest for Manifest main attributes
使用idea对spark项目进行打包,然后将jar包放到spark集群进行运行,但报错Invalid signature file digest for Manifest main attributes解决方案:使用以下命令消除jar包META-INF目录的*.SF,.DSA,.RSA文件。zip -d xxx.jar META-INF/*.RSA META-INF/*.DSA META-INF/*.SF...原创 2021-10-09 11:51:46 · 275 阅读 · 0 评论 -
Spark报错:`HiveFileFormat`. It doesn‘t match the specified format `OrcFileFormat`
Hive 表是 orc + zlibSpark 写入Hive报错:HiveFileFormat`. It doesn't match the specified format `OrcFileFormat即使将 Spark 写入 Hive 的代码改为df.write.format('orc') 也还是报错。解决方案:df.write.format('Hive')原创 2021-09-16 14:51:48 · 703 阅读 · 0 评论 -
spark报错:class “javax.servlet.ServletRegistration“‘s signer information does not match signer
spark 运行报错:java.lang.SecurityException: class "javax.servlet.ServletRegistration"'s signer information does not match signer information of other classes in the same package这种情况是 sbt 导入的依赖包含有多个 javax.servlet的包。解决方案是通过 exclude去掉...原创 2021-09-16 10:36:02 · 863 阅读 · 0 评论