datax template build

最新推荐文章于 2024-01-05 15:06:52 发布

itcast_xiaohuer

最新推荐文章于 2024-01-05 15:06:52 发布

阅读量104

点赞数 1

分类专栏：工具类文章标签： hadoop 大数据 hdfs

本文链接：https://blog.csdn.net/m0_38053092/article/details/128705745

版权

工具类专栏收录该内容

22 篇文章 1 订阅

订阅专栏

hdfs to mysql template demo 测试配置有效，用于快速开发工作

{
  "job": {
    "setting": {
      "speed": {
        "channel": "1"
      }
    },
    "content": [
      {
        "reader": {
          "name": "hdfsreader",
          "parameter": {
            "path": "/user/hive/warehouse/datahome.db/dws_phone_addr_user",
            "defaultFS": "hdfs://IP:8020",
            "column": [
              "*"
            ],
            "fileType": "text",
            "encoding": "UTF-8",
            "fieldDelimiter": "\u0001"
          }
        },
        "writer": {
          "name": "mysqlwriter",
          "parameter": {
            "column": [
              "phone",
              "user_name",
              "addr"
            ],
            "connection": [
              {
                "jdbcUrl": "jdbc:mysql://IP:3306/datahome?characterEncoding=utf8&useSSL=false&serverTimezone=UTC&rewriteBatchedStatements=true",
                "table": [
                  "dws_phone_addr_user"
                ]
              }
            ],
            "password": "root",
            "username": "****",
            "writeMode": "insert"
          }
        }
      }
    ]
  }
}