![](https://img-blog.csdnimg.cn/20201014180756724.png?x-oss-process=image/resize,m_fixed,h_64,w_64)
spark
乄浅醉
这个作者很懒,什么都没留下…
展开
-
spark on yarn启动异常
一个困扰了我好久的异常:17/05/31 23:53:23 ERROR spark.SparkContext: Error initializing SparkContext.org.apache.spark.SparkException: Yarn application has already ended! It might have been killed or unable to laun原创 2017-06-01 00:11:07 · 11858 阅读 · 6 评论 -
spark on yarn 异常记录二
通过spark-submit 向集群提交任务时,–num-executors 数量大于1即会出现异常,异常如下:17/06/04 11:47:03 WARN DefaultChannelPipeline: An exception 'java.lang.NoSuchMethodError: org.apache.spark.network.client.TransportClient.getChan原创 2017-06-04 16:19:42 · 1919 阅读 · 2 评论 -
org.apache.spark.sql.catalyst.expressions.GenericRowWithSchema cannot be cast to scala.Tuple2
今天在写spark 提数的时候遇到一个异常,如下Caused by: java.lang.ClassCastException: org.apache.spark.sql.catalyst.expressions.GenericRowWithSchema cannot be cast to scala.Tuple2 at $anonfun$1$$anonfun$apply$1.apply(<co原创 2017-09-07 17:11:26 · 12128 阅读 · 3 评论