org.apache.spark.sql.catalyst.expressions.codegen.UnsafeRowWriter.write spark查询oracle异常

最新推荐文章于 2022-10-28 13:55:38 发布

邪门的苦瓜

最新推荐文章于 2022-10-28 13:55:38 发布

阅读量1.2k

点赞数

分类专栏： UnsafeRowWriter 文章标签： UnsafeRowWriter spark

本文链接：https://blog.csdn.net/u010791030/article/details/89921930

版权

UnsafeRowWriter 专栏收录该内容

1 篇文章 0 订阅

订阅专栏

本来oracle字段是VARCHAR2，然后查询的时候又带了个to_char(xx)导致下面错误

2019/05/07 15:23:03.198 +0800 WARN [TaskSetManager] [Azkaban] Lost task 0.0 in stage 1.0 (TID 5, localhost, executor driver): java.lang.RuntimeException: 系统异常
   at com.xxxx.action.base.BaseAction$1.call(BaseAction.java:288)
   at com.xxxx.action.base.BaseAction$1.call(BaseAction.java:276)
   at org.apache.spark.api.java.JavaRDDLike$$anonfun$fn$7$1.apply(JavaRDDLike.scala:186)
   at org.apache.spark.api.java.JavaRDDLike$$anonfun$fn$7$1.apply(JavaRDDLike.scala:186)
   at org.apache.spark.rdd.RDD$$anonfun$mapPartitions$1$$anonfun$apply$23.apply(RDD.scala:796)
   at org.apache.spark.rdd.RDD$$anonfun$mapPartitions$1$$anonfun$apply$23.apply(RDD.scala:796)
   at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:38)
   at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:323)
   at org.apache.spark.rdd.RDD.iterator(RDD.scala:287)
   at org.apache.spark.rdd.UnionRDD.compute(UnionRDD.scala:105)
   at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:323)
   at org.apache.spark.rdd.RDD.iterator(RDD.scala:287)
   at org.apache.spark.rdd.UnionRDD.compute(UnionRDD.scala:105)
   at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:323)
   at org.apache.spark.rdd.RDD.iterator(RDD.scala:287)
   at org.apache.spark.rdd.UnionRDD.compute(UnionRDD.scala:105)
   at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:323)
   at org.apache.spark.rdd.RDD.iterator(RDD.scala:287)
   at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:96)
   at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:53)
   at org.apache.spark.scheduler.Task.run(Task.scala:99)
   at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:325)
   at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
   at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.NullPointerException
   at org.apache.spark.sql.catalyst.expressions.codegen.UnsafeRowWriter.write(UnsafeRowWriter.java:210)
   at org.apache.spark.sql.catalyst.expressions.GeneratedClass$GeneratedIterator.processNext(Unknown Source)
   at org.apache.spark.sql.execution.BufferedRowIterator.hasNext(BufferedRowIterator.java:43)
   at org.apache.spark.sql.execution.WholeStageCodegenExec$$anonfun$8$$anon$1.hasNext(WholeStageCodegenExec.scala:377)
   at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:408)
   at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:408)
   at scala.collection.convert.Wrappers$IteratorWrapper.hasNext(Wrappers.scala:30)
   at com.xxxx.action.base.BaseAction$1.call(BaseAction.java:281)
   ... 24 more