spark
xiaolin93
才华撑不起抱负,就好好学习…
展开
-
测试从kafka读取数据到sparkstreaming是遇到以下这个错误
java.lang.IllegalArgumentException: requirement failed: No output operations registered, so nothing to execute 解决方法:tranformation最后一步产生的那个RDD必须有相应Action操作,例如massages.print()等原创 2017-08-11 15:15:02 · 2949 阅读 · 0 评论 -
提交spark任务时报错
Exception in thread "main" java.lang.SecurityException: Invalid signature file digest for Manifest main attributes at sun.security.util.SignatureFileVerifier.processImpl(SignatureFileVerifier.java:28原创 2017-08-30 16:15:38 · 565 阅读 · 0 评论 -
scala在spark中使用log4j报不能序列化
Caused by: java.io.NotSerializableException: org.apache.log4j.Logger Serialization stack: - object not serializable (class: org.apache.log4j.Logger, value: org.apache.log4j.Logger@149ff4b5) - field原创 2017-11-14 09:19:31 · 2095 阅读 · 0 评论