![](https://img-blog.csdnimg.cn/20201014180756927.png?x-oss-process=image/resize,m_fixed,h_64,w_64)
Canal
Zsigner
这个作者很懒,什么都没留下…
展开
-
【CANAL】canal 针对message过大无法写入kafka解决方案
背景:在canal.instance.log中看到message过大,无法写入kafka报错log:[pool-348-thread-5] ERROR c.a.o.canal.connector.kafka.producer.CanalKafkaProducer - java.util.concurrent.ExecutionException: org.apache.kafka.common.errors.RecordTooLargeException: The request includ.原创 2020-12-23 12:27:54 · 2873 阅读 · 1 评论 -
【CANAL HA】Could not find first log file name in binary log index file
1、canal 单机版可以参考下面的博客:https://blog.csdn.net/Zsigner/article/details/1089753902、CANAL HA模式这篇文章主要是针对CANALADMIN【HA】集群模式的报错信息:2020-11-30 11:09:22.568 [destination = test , address = /127.0.0.1:3306 , EventParser] WARN c.a.o.c.p.inbound.mysql.rds.Rd..原创 2020-11-30 15:34:28 · 704 阅读 · 0 评论 -
【Canal】 从binlog接入kafka,动态创建topic 写入数据
1、接入kafka(以下内容来自官方文档:https://github.com/alibaba/canal/wiki/Canal-Kafka-RocketMQ-QuickStart)Canal Kafka RocketMQ QuickStart基本说明canal 1.1.1版本之后, 默认支持将canal server接收到的binlog数据直接投递到MQ, 目前默认支持的MQ系统有:kafka:https://github.com/apache/kafka RocketMQ :...原创 2020-10-15 17:29:32 · 3929 阅读 · 0 评论 -
【Canal】ERROR column size is not match for table:db_test.test,22 vs 21 解决
背景:canal 版本 1.1.4错误提示:ERROR com.alibaba.otter.canal.common.utils.NamedThreadFactory - from MultiStageCoprocessor-Parser-example-3com.alibaba.otter.canal.parse.exception.CanalParseException: com.alibaba.otter.canal.parse.exception.CanalParseExceptio原创 2020-10-14 14:59:50 · 2382 阅读 · 2 评论 -
【Canal】 Error:com.alibaba.otter.canal.common.alarm.LogAlarmHandler - destination:example[java.io.IOE
查看example日志发现异常如下:2020-10-09 11:06:45.011 [destination = example , address = /10.0.0.39:3306 , EventParser] ERROR com.alibaba.otter.canal.common.alarm.LogAlarmHandler - destination:example[java.io.IOException: Received error packet: errno = 1236, sqlsta原创 2020-10-09 11:38:49 · 6893 阅读 · 0 评论