{
"job": {
"setting": {
"speed": {
"channel": 32
}
},
"content": [{
"reader": {
"name": "mysqlreader",
"parameter": {
"username": "数据库用户名",
"password": "数据库密码",
"column":[
"id",
"id",
"列名1",
"列名2",
"列名n"
],
"connection": [{
"table": [
"表名1",
"表名2",
"表名n"
],
"jdbcUrl": [
"jdbc:mysql://IP地址:端口号/数据库名称"
]
}]
}
},
"writer": {
"name": "elasticsearchwriter",
"parameter": {
"endpoint": "http://es地址:9200/",
"index": "es索引名称",
"accessId": "admin",
"accessKey": "1111",
"timeout": 3600000,
"cleanup": false,
"discovery": false,
"batchSize": 4096,
"splitter": ",",
"column": [{
"name": "_id",
"type": "id"
},
{
"name": "id",
"type": "long"
}, {
"name": "es字段1",
"type": "integer"
}, {
"name": "es字段2",
"type": "keyword"
}, {
"name": "es字段n",
"type": "keyword"
}
]
}
}
}]
}
}
datax命令:python datax/bin/datax.py --jvm='-Xms10g -Xmx10g' json脚本文件名称
mysql数据同步到es的datax json脚本编写
最新推荐文章于 2024-07-10 14:22:05 发布
该博客介绍了如何使用DataX将MySQL数据库中的数据高效地迁移到Elasticsearch中。配置包括设置读取速度、指定数据库连接信息、选择表名及字段,并定义Elasticsearch的索引和写入参数。
摘要由CSDN通过智能技术生成