- 博客(4)
- 问答 (1)
- 收藏
- 关注
RSS订阅原创 Spark Structured Streaming：修改Task数不生效问题
问题：代码里添加参数修改partition参数后不生效："spark.sql.shuffle.partitions","30"解决：如果Structured Streaming代码sink部分有设置checkpointLocation，如：option("checkpointLocation","hdfs://hbase0/kafka/offset/kafka_order_agg...
2019-08-27 18:20:35
565
原创 kafka:UNKNOWN_TOPIC_OR_PARTITION
Error while fetching metadata with correlation id 11 : {xxxx=UNKNOWN_TOPIC_OR_PARTITION}可能原因：topic不存在，切自动创建失败设置：auto.create.topics.enable=true...
2019-08-23 15:09:01
30558
2
原创 Spark Structured Streaming Error:java.lang.ClassCastException: org.apache.spark.sql.catalyst.express
Spark Structured Streaming Error:java.lang.ClassCastException: org.apache.spark.sql.catalyst.express解决：val toString1 = udf{(window:GenericRowWithSchema) => window.mkString("-")}val windowCou...
2019-08-15 21:13:56
393
原创 Pg_squeeze:Replica identity “full“ not supported
PG_SQUEEZE Logic Replication Error:解决：https://blog.csdn.net/u012551524/article/details/89845167ALTER TABLE test2 REPLICA IDENTITY DEFAULT;
2019-08-15 21:06:43
509
空空如也
求助：kettle连接cdh510-hbase报错问题
2017-07-12
TA创建的收藏夹 TA关注的收藏夹
TA关注的人