Saprk
一点IT技术
这个作者很懒,什么都没留下…
展开
-
spark读取mysql某列值,封装成List集合
spark读取mysql某列值,封装成List集合def main(args: Array[String]) = { Logger.getLogger("org").setLevel(Level.ERROR) val sparkSession = SparkSession .builder() .master("local[*]") .ap...原创 2020-04-26 16:33:55 · 1184 阅读 · 0 评论 -
Spark 运行警告:spark.debug.maxToStringFields
spark运行报错Truncated the string representation of a plan since it was too large. This behavior can be adjusted by setting ‘spark.debug.maxToStringFields’ in SparkEnv.conf.可以设置一个参数.config(“spark.debug....原创 2020-04-26 12:08:26 · 2454 阅读 · 0 评论