spark
文章平均质量分 76
xiaolinzi007
这个作者很懒,什么都没留下…
展开
-
New Memory allocation 1046759 bytes is smaller than the minimum allocation size of 1048576 bytes.
org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 3.0 failed 4 times, most recent failure: Lost task 0.3 in stage 3.0 (TID 78, hdp57.car.bj2.yongche.com): org.apache.h原创 2017-04-14 18:01:43 · 5572 阅读 · 0 评论 -
sparkSQL读取hive分区表的问题追踪
示例读取的table格式为parqut格式,异常堆栈信息: java.lang.OutOfMemoryError: GC overhead limit exceeded at java.lang.StringBuilder. at java.io.ObjectStreamClass.getClassSignature(ObjectStreamClass.java:1458) at java.原创 2017-05-26 10:11:46 · 6715 阅读 · 0 评论