Spark报错处理系列之:Exception in thread "main" org.apache.spark.SparkException: Job aborted due to stage failure: Total size of serialized results of 23 tasks 1043.8 MB is bigger than spark.driver.maxResultSize 1024.0 MB
一、完整报错
- Exception in thread “main” org.apache.spark.SparkException: Job aborted due to stage failure: Total size of serialized results of 23 tasks (1043.8 MB) is bigger than spark.driver.maxResultSize (1024.0 MB)
at org.apache.spark.scheduler.DAGScheduler.org a p a c h