在datax中提前将MySQL数据进行大小写转换

在datax中提前将MySQL数据进行大小写转换
修改datax的json文件

{
  "job": {
    "content": [{
      "transformer": [{
        "parameter": {
          "code": "for(int i=0;i<record.getColumnNumber();i++){if(record.getColumn(i).getByteSize()!=0){Column column = record.getColumn(i); def str = column.asString(); def newStr=null; newStr=str.replaceAll(\"[\\r\\n]\",\"\"); record.setColumn(i, new StringColumn(newStr)); };};return record;",
          "extraPackage": []
        },
        "name": "dx_groovy"
      }],
      "writer": {
        "parameter": {
          "writeMode": "append",
          "fieldDelimiter": "\u0001",
          "column": [{
            "type": "string",
            "name": "id"
          }, {
            "type": "string",
            "name": "code"
          }, {
            "type": "string",
            "name": "title"
          }, {
            "type": "int",
            "name": "print_count"
          }, {
            "type": "string",
            "name": "effective_date"
          }, {
            "type": "string",
            "name": "expiry_date"
          }, {
            "type": "string",
            "name": "time_slots"
          }, {
            "type": "string",
            "name": "department_id"
          }, {
            "type": "string",
            "name": "department_name"
          }, {
            "type": "int",
            "name": "status"
          }, {
            "type": "int",
            "name": "type"
          }, {
            "type": "string",
            "name": "created_date"
          }, {
            "type": "string",
            "name": "created_by"
          }, {
            "type": "string",
            "name": "last_modified_date"
          }, {
            "type": "string",
            "name": "last_modified_by"
          }, {
            "type": "int",
            "name": "rest_day"
          }],
          "path": "${targetdir}",
          "fileType": "text",
          "defaultFS": "hdfs://mycluster:8020",
          "compress": "gzip",
          "fileName": "cn_work_hours"
        },
        "name": "hdfswriter"
      },
      "reader": {
        "parameter": {
          "username": "dw_readonly",
          "connection": [{
            "querySql": [
              "
				select lower(id),
				       code,
				       title,
				       print_count,
				       effective_date,
				       expiry_date,
				       lower(REPLACE(time_slots, '.', ',')),
				       lower(department_id),
				       upper(department_name),
				       status,
				       type,
				       created_date,
				       created_by,
				       last_modified_date,
				       last_modified_by,
				       rest_day
                 from cn_work_hours
              "
            ],
            "jdbcUrl": ["jdbc:mysql://******"]
          }],
          "password": "****",
          "splitPk": ""
        },
        "name": "mysqlreader"
      }
    }],
    "setting": {
      "speed": {
        "channel": 3
      },
      "errorLimit": {
        "record": 0,
        "percentage": 0.02
      }
    }
  }
}
  • 0
    点赞
  • 1
    收藏
    觉得还不错? 一键收藏
  • 打赏
    打赏
  • 0
    评论

“相关推荐”对你有帮助么?

  • 非常没帮助
  • 没帮助
  • 一般
  • 有帮助
  • 非常有帮助
提交
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包

打赏作者

m0_37759590

你的鼓励将是我创作的最大动力

¥1 ¥2 ¥4 ¥6 ¥10 ¥20
扫码支付:¥1
获取中
扫码支付

您的余额不足,请更换扫码支付或充值

打赏作者

实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值