Debezium系列之:基于wal2json_streaming插件实时处理postgresql数据库超大数据
一、背景
- wal2json无处处理postgresql数据库过大数据
- 更多详细内容参考下面这篇博客:
Debezium报错处理系列十二:Cannot enlarge string buffer containing 1073740820 bytes by 1704 more bytes.
二、指定使用wal2json_streaming插件
- “plugin.name”: “wal2json_streaming”
三、基于wal2json_streaming提交debezium postgresql数据库connector
curl -u debezium:optics123 'http://debezium-001:8186/connectors' -X POST -i -H "Content-Type:application/json" -d
'{
"name": "pgsql-optics-connector",
"config": {
"connector.class": "