qq_45124566的博客

Spark SQL报错：java.lang.StackOverflowError

Coalesce and Repartition Hint或者spark.sql.adaptive.enabled和spark.sql.adaptive.coalescePartitions.enabled为true

限制Spark/SparkSQL往HDFS写出数据时，生成_SUCCESS文件

ERROR shuffle.RetryingBlockFetcher: Exception while beginning fetch of 1 outstanding blocks java.io.IOException: Failed to connect to hostname/192.168.xx.xxx:50002 at

org.apache.spark.SparkException:Task failed while writing rows.Caused by: org.apache.hadoop.hdfs.protocol.DSQuotaExceededException: The DiskSpace quota of /user/hive/warehouse/hs_data_odsdb.db is exceeded: quota = 13194139533312 B = 12 TB but diskspace ..

Spark错误：It is possible the underlying files have been updated. You can explicitly invalidate the cache in Spark by running ‘REFRESH TABLE tableName’ command in SQL or by recreating the Dataset/DataFrame involved.