Maxwell、FlinkcDc、mysql binlog使用说明

一、flink_cdc监控mysql

{
    "before": {
        "id": 11,
        "create_time": 1726154481000000,
        "update_time": 1726154493000000,
        "name": "46548saf"
    },
    "after": null,
    "source": {
        "version": "1.6.4.Final",
        "connector": "mysql",
        "name": "mysql_binlog_source",
        "ts_ms": 1726126172000,
        "snapshot": "false",
        "db": "financial_lease",
        "sequence": null,
        "table": "business_partner",
        "server_id": 1,
        "gtid": null,
        "file": "mysql-bin.000003",
        "pos": 407,
        "row": 0,
        "thread": null,
        "query": null
    },
    "op": "d",
    "ts_ms": 1726126172232,
    "transaction": null
}

二、Maxwell 监控mysql获取格式

{
    "database": "financial_lease",
    "table": "credit_facility_status",
    "type": "update",
    "ts": 1726118701,
    "xid": 29725,
    "commit": true,
    "data": {
        "id": 8503,
        "create_time": "2024-01-03 17:00:00.000000",
        "update_time": "2024-01-03 17:00:00.000000",
        "action_taken": 1,
        "status": 1,
        "credit_facility_id": 1296,
        "employee_id": 749,
        "signatory_id": null
    },
    "old": {
        "credit_facility_id": null
    }
}

三、mysql开启binlog步骤

1、编辑/etc/my.cnf文件
2、末尾增加配置（注意开启当多个库都需要开启binlog的时候，需要重新添加inlog-do-db参数，再加库名）

#数据库id
server-id = 1
###启动binlog，该参数的值会作为binlog的文件名
log-bin=mysql-bin
###binlog类型，maxwell要求为row类型
binlog_format=row
###启用binlog的数据库，需根据实际情况作出修改
binlog-do-db=financial_lease
binlog-do-db=financial_lease_config

3、重启mysql服务

sudo systemctl restart mysqld