Streamsets（六）SS读取binlog数据实时同步到MySQL

1、说明

实时同步binlog数据到MySQL我使用了2种方式，

2、方式一

第一种方式较为繁琐，数据从binlog流出，经过JS数据解析器将必要的字段解析出来，流入操作选择器，根据具体需要执行的增删改操作选择最后的JDBC Producer，pipeline如下：

binlog数据到JS数据解析器之前是这样

{
	"BinLogFilename": "mysql-bin.000001",
	"Type": "INSERT",
	"Table": "test",
	"ServerId": 1,
	"BinLogPosition": 3795464,
	"Database": "test",
	"Data": {
		"address": "安徽蚌埠",
		"name": "张张",
		"update_at": 1585817413000,
		"weight": 134.0,
		"id": 14,
		"create_at": 1585817413000,
		"height": 177.0
	},
	"Timestamp": 1585788613000,
	"Offset": "mysql-bin.000001:3795464"
} {
	"BinLogFilename": "mysql-bin.000001",
	"Type": "UPDATE",
	"Table": "test",
	"ServerId": 1,
	"BinLogPosition": 3795837,
	"Database": "test",
	"OldData": {
		"address": "美国",
		"name": "守望",
		"update_at": 1585763177000,
		"weight": 166.0,
		"id": 13,
		"create_at": 1585763177000,
		"height": 180.0
	},
	"Data": {
		"address": "美国暴雪",
		"name": "守望",
		"update_at": 1585817417000,
		"weight": 166.0,
		"id": 13,
		"create_at": 1585763177000,
		"height": 180.0
	},
	"Timestamp": 1585788617000,
	"Offset": "mysql-bin.000001:3795837"
}

binlog数据出JS数据解析器之后是这样的，Table、Database、Type、Offs