datax数据入库模板

最新推荐文章于 2024-04-25 19:01:14 发布
最新推荐文章于 2024-04-25 19:01:14 发布
阅读量563 收藏 7
点赞数 9
分类专栏： python-datax sql hive 文章标签： python datax
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
本文链接：https://blog.csdn.net/zkkkkkkkkkkkkk/article/details/135932280
版权
sql 同时被 3 个专栏收录
10 篇文章 0 订阅
订阅专栏
hive
3 篇文章 0 订阅
订阅专栏
python-datax
1 篇文章 0 订阅
订阅专栏

目录

一、txt2hive

二、txt2mysql

一、txt2hive

{
    "setting": {},
    "job": {
        "setting": {
            "speed": {
                "channel": 4
            }
        },
        "errorLimit": {
            "percentage": 0.02
        },
        "content": [
            {
                "reader": {
                    "name": "txtfilereader",
                    "parameter": {
                        "path": [
                            "D:\\datax_project\\datax\\zqykj\\sourceData"
                        ],
                        "fileName": "",
                        "encoding": "UTF-8",
                        "column": [
                            {
                                "index": 0,
                                "type": "string"
                            },
                            {
                                "index": 1,
                                "type": "string"
                            },
                            {
                                "index": 2,
                                "type": "string"
                            },
                            {
                                "index": 3,
                                "type": "string"
                            },
                            {
                                "index": 4,
                                "type": "string"
                            },
                            {
                                "index": 5,
                                "type": "string"
                            },
                            {
                                "index": 6,
                                "type": "string"
                            },
                            {
                                "index": 7,
                                "type": "string"
                            },
                            {
                                "index": 8,
                                "type": "string"
                            },
                            {
                                "index": 9,
                                "type": "string"
                            },
                            {
                                "index": 10,
                                "type": "string"
                            },
                            {
                                "index": 11,
                                "type": "string"
                            },
                            {
                                "index": 12,
                                "type": "string"
                            },
                            {
                                "index": 13,
                                "type": "string"
                            },
                            {
                                "index": 14,
                                "type": "string"
                            },
                            {
                                "index": 15,
                                "type": "string"
                            },
                            {
                                "index": 16,
                                "type": "string"
                            },
                            {
                                "index": 17,
                                "type": "string"
                            },
                            {
                                "index": 18,
                                "type": "string"
                            },
                            {
                                "index": 19,
                                "type": "string"
                            },
                            {
                                "index": 20,
                                "type": "string"
                            },
                            {
                                "index": 21,
                                "type": "string"
                            },
                            {
                                "index": 22,
                                "type": "string"
                            },
                            {
                                "index": 23,
                                "type": "string"
                            },
                            {
                                "index": 24,
                                "type": "string"
                            },
                            {
                                "index": 25,
                                "type": "string"
                            },
                            {
                                "index": 26,
                                "type": "string"
                            },
                            {
                                "index": 27,
                                "type": "string"
                            },
                            {
                                "index": 28,
                                "type": "string"
                            },
                            {
                                "index": 29,
                                "type": "string"
                            },
                            {
                                "index": 30,
                                "type": "string"
                            },
                            {
                                "index": 31,
                                "type": "string"
                            },
                            {
                                "index": 32,
                                "type": "string"
                            },
                            {
                                "index": 33,
                                "type": "string"
                            },
                            {
                                "index": 34,
                                "type": "string"
                            },
                            {
                                "index": 35,
                                "type": "string"
                            },
                            {
                                "index": 36,
                                "type": "string"
                            },
                            {
                                "index": 37,
                                "type": "string"
                            },
                            {
                                "index": 38,
                                "type": "string"
                            },
                            {
                                "index": 39,
                                "type": "string"
                            },
                            {
                                "index": 40,
                                "type": "string"
                            },
                            {
                                "index": 41,
                                "type": "string"
                            },
                            {
                                "index": 42,
                                "type": "string"
                            },
                            {
                                "index": 43,
                                "type": "string"
                            },
                            {
                                "index": 44,
                                "type": "string"
                            },
                            {
                                "index": 45,
                                "type": "string"
                            },
                            {
                                "index": 46,
                                "type": "string"
                            },
                            {
                                "index": 47,
                                "type": "string"
                            },
                            {
                                "index": 48,
                                "type": "string"
                            },
                            {
                                "index": 49,
                                "type": "string"
                            },
                            {
                                "index": 50,
                                "type": "string"
                            },
                            {
                                "index": 51,
                                "type": "string"
                            },
                            {
                                "index": 52,
                                "type": "string"
                            },
                            {
                                "index": 53,
                                "type": "string"
                            },
                            {
                                "index": 54,
                                "type": "string"
                            },
                            {
                                "index": 55,
                                "type": "string"
                            },
                            {
                                "index": 56,
                                "type": "string"
                            },
                            {
                                "index": 57,
                                "type": "string"
                            },
                            {
                                "index": 58,
                                "type": "string"
                            },
                            {
                                "index": 59,
                                "type": "string"
                            },
                            {
                                "index": 60,
                                "type": "string"
                            },
                            {
                                "index": 61,
                                "type": "string"
                            },
                            {
                                "index": 62,
                                "type": "string"
                            },
                            {
                                "index": 63,
                                "type": "string"
                            },
                            {
                                "index": 64,
                                "type": "string"
                            },
                            {
                                "index": 65,
                                "type": "string"
                            },
                            {
                                "index": 66,
                                "type": "string"
                            },
                            {
                                "index": 67,
                                "type": "string"
                            },
                            {
                                "index": 68,
                                "type": "string"
                            },
                            {
                                "index": 69,
                                "type": "string"
                            },
                            {
                                "index": 70,
                                "type": "string"
                            },
                            {
                                "index": 71,
                                "type": "string"
                            },
                            {
                                "index": 72,
                                "type": "string"
                            },
                            {
                                "index": 73,
                                "type": "string"
                            },
                            {
                                "index": 74,
                                "type": "string"
                            },
                            {
                                "index": 75,
                                "type": "string"
                            },
                            {
                                "index": 76,
                                "type": "string"
                            },
                            {
                                "index": 77,
                                "type": "string"
                            },
                            {
                                "index": 78,
                                "type": "string"
                            },
                            {
                                "index": 79,
                                "type": "string"
                            },
                            {
                                "index": 80,
                                "type": "string"
                            },
                            {
                                "index": 81,
                                "type": "string"
                            },
                            {
                                "index": 82,
                                "type": "string"
                            },
                            {
                                "index": 83,
                                "type": "string"
                            },
                            {
                                "index": 84,
                                "type": "string"
                            },
                            {
                                "index": 85,
                                "type": "string"
                            },
                            {
                                "index": 86,
                                "type": "string"
                            },
                            {
                                "index": 87,
                                "type": "string"
                            },
                            {
                                "index": 88,
                                "type": "string"
                            },
                            {
                                "index": 89,
                                "type": "string"
                            },
                            {
                                "index": 90,
                                "type": "string"
                            },
                            {
                                "index": 91,
                                "type": "string"
                            },
                            {
                                "index": 92,
                                "type": "string"
                            },
                            {
                                "index": 93,
                                "type": "string"
                            },
                            {
                                "index": 94,
                                "type": "string"
                            },
                            {
                                "index": 95,
                                "type": "string"
                            },
                            {
                                "index": 96,
                                "type": "string"
                            },
                            {
                                "index": 97,
                                "type": "string"
                            },
                            {
                                "index": 98,
                                "type": "string"
                            },
                            {
                                "index": 99,
                                "type": "string"
                            },
                            {
                                "index": 100,
                                "type": "string"
                            },
                            {
                                "index": 101,
                                "type": "string"
                            }
                        ],
                        "fieldDelimiter": "|+|",
                        "fileFormat": "dat",
                        "nullFormat": "^(\\s*|\\s*\\.\\s*|null)$"
                    }
                },
                "writer": {
                    "name": "hdfswriter",
                    "parameter": {
                        "defaultFS": "hdfs://172.30.6.5:8020",
                        "fieldDelimiter": "|",
                        "fileType": "ORC",
                        "path": "/user/hive/warehouse/jxpoc_dw.db/t2a_trans_init/",
                        "fileName": "t2a_trans_init",
                        "writeMode": "truncate",
                        "column": [
                            {
                                "index": 0,
                                "type": "string"
                            },
                            {
                                "index": 1,
                                "type": "string"
                            },
                            {
                                "index": 2,
                                "type": "string"
                            },
                            {
                                "index": 3,
                                "type": "string"
                            },
                            {
                                "index": 4,
                                "type": "string"
                            },
                            {
                                "index": 5,
                                "type": "string"
                            },
                            {
                                "index": 6,
                                "type": "string"
                            },
                            {
                                "index": 7,
                                "type": "string"
                            },
                            {
                                "index": 8,
                                "type": "string"
                            },
                            {
                                "index": 9,
                                "type": "string"
                            },
                            {
                                "index": 10,
                                "type": "string"
                            },
                            {
                                "index": 11,
                                "type": "string"
                            },
                            {
                                "index": 12,
                                "type": "string"
                            },
                            {
                                "index": 13,
                                "type": "string"
                            },
                            {
                                "index": 14,
                                "type": "string"
                            },
                            {
                                "index": 15,
                                "type": "string"
                            },
                            {
                                "index": 16,
                                "type": "string"
                            },
                            {
                                "index": 17,
                                "type": "string"
                            },
                            {
                                "index": 18,
                                "type": "string"
                            },
                            {
                                "index": 19,
                                "type": "string"
                            },
                            {
                                "index": 20,
                                "type": "string"
                            },
                            {
                                "index": 21,
                                "type": "string"
                            },
                            {
                                "index": 22,
                                "type": "string"
                            },
                            {
                                "index": 23,
                                "type": "string"
                            },
                            {
                                "index": 24,
                                "type": "string"
                            },
                            {
                                "index": 25,
                                "type": "string"
                            },
                            {
                                "index": 26,
                                "type": "string"
                            },
                            {
                                "index": 27,
                                "type": "string"
                            },
                            {
                                "index": 28,
                                "type": "string"
                            },
                            {
                                "index": 29,
                                "type": "string"
                            },
                            {
                                "index": 30,
                                "type": "string"
                            },
                            {
                                "index": 31,
                                "type": "string"
                            },
                            {
                                "index": 32,
                                "type": "string"
                            },
                            {
                                "index": 33,
                                "type": "string"
                            },
                            {
                                "index": 34,
                                "type": "string"
                            },
                            {
                                "index": 35,
                                "type": "string"
                            },
                            {
                                "index": 36,
                                "type": "string"
                            },
                            {
                                "index": 37,
                                "type": "string"
                            },
                            {
                                "index": 38,
                                "type": "string"
                            },
                            {
                                "index": 39,
                                "type": "string"
                            },
                            {
                                "index": 40,
                                "type": "string"
                            },
                            {
                                "index": 41,
                                "type": "string"
                            },
                            {
                                "index": 42,
                                "type": "string"
                            },
                            {
                                "index": 43,
                                "type": "string"
                            },
                            {
                                "index": 44,
                                "type": "string"
                            },
                            {
                                "index": 45,
                                "type": "string"
                            },
                            {
                                "index": 46,
                                "type": "string"
                            },
                            {
                                "index": 47,
                                "type": "string"
                            },
                            {
                                "index": 48,
                                "type": "string"
                            },
                            {
                                "index": 49,
                                "type": "string"
                            },
                            {
                                "index": 50,
                                "type": "string"
                            },
                            {
                                "index": 51,
                                "type": "string"
                            },
                            {
                                "index": 52,
                                "type": "string"
                            },
                            {
                                "index": 53,
                                "type": "string"
                            },
                            {
                                "index": 54,
                                "type": "string"
                            },
                            {
                                "index": 55,
                                "type": "string"
                            },
                            {
                                "index": 56,
                                "type": "string"
                            },
                            {
                                "index": 57,
                                "type": "string"
                            },
                            {
                                "index": 58,
                                "type": "string"
                            },
                            {
                                "index": 59,
                                "type": "string"
                            },
                            {
                                "index": 60,
                                "type": "string"
                            },
                            {
                                "index": 61,
                                "type": "string"
                            },
                            {
                                "index": 62,
                                "type": "string"
                            },
                            {
                                "index": 63,
                                "type": "string"
                            },
                            {
                                "index": 64,
                                "type": "string"
                            },
                            {
                                "index": 65,
                                "type": "string"
                            },
                            {
                                "index": 66,
                                "type": "string"
                            },
                            {
                                "index": 67,
                                "type": "string"
                            },
                            {
                                "index": 68,
                                "type": "string"
                            },
                            {
                                "index": 69,
                                "type": "string"
                            },
                            {
                                "index": 70,
                                "type": "string"
                            },
                            {
                                "index": 71,
                                "type": "string"
                            },
                            {
                                "index": 72,
                                "type": "string"
                            },
                            {
                                "index": 73,
                                "type": "string"
                            },
                            {
                                "index": 74,
                                "type": "string"
                            },
                            {
                                "index": 75,
                                "type": "string"
                            },
                            {
                                "index": 76,
                                "type": "string"
                            },
                            {
                                "index": 77,
                                "type": "string"
                            },
                            {
                                "index": 78,
                                "type": "string"
                            },
                            {
                                "index": 79,
                                "type": "string"
                            },
                            {
                                "index": 80,
                                "type": "string"
                            },
                            {
                                "index": 81,
                                "type": "string"
                            },
                            {
                                "index": 82,
                                "type": "string"
                            },
                            {
                                "index": 83,
                                "type": "string"
                            },
                            {
                                "index": 84,
                                "type": "string"
                            },
                            {
                                "index": 85,
                                "type": "string"
                            },
                            {
                                "index": 86,
                                "type": "string"
                            },
                            {
                                "index": 87,
                                "type": "string"
                            },
                            {
                                "index": 88,
                                "type": "string"
                            },
                            {
                                "index": 89,
                                "type": "string"
                            },
                            {
                                "index": 90,
                                "type": "string"
                            },
                            {
                                "index": 91,
                                "type": "string"
                            },
                            {
                                "index": 92,
                                "type": "string"
                            },
                            {
                                "index": 93,
                                "type": "string"
                            },
                            {
                                "index": 94,
                                "type": "string"
                            },
                            {
                                "index": 95,
                                "type": "string"
                            },
                            {
                                "index": 96,
                                "type": "string"
                            },
                            {
                                "index": 97,
                                "type": "string"
                            },
                            {
                                "index": 98,
                                "type": "string"
                            },
                            {
                                "index": 99,
                                "type": "string"
                            },
                            {
                                "index": 100,
                                "type": "string"
                            },
                            {
                                "index": 101,
                                "type": "string"
                            }
                        ],
                        "tableName": null,
                        "hdfsPath": null
                    }
                }
            }
        ]
    }
}

 

二、txt2mysql

{
    "setting": {},
    "job": {
        "setting": {
            "speed": {
                "channel": 4
            }
        },
        "errorLimit": {
            "percentage": 0.02
        },
        "content": [
            {
                "reader": {
                    "name": "txtfilereader",
                    "parameter": {
                        "path": [
                            "C:/Users/dell/Desktop/history/"
                        ],
                        "fileName": "P20210257_JS_FXQ_TRAN_20220827_0001.dat",
                        "encoding": "UTF-8",
                        "column": [
                            {
                                "index": 0,
                                "type": "string"
                            },
                            {
                                "index": 1,
                                "type": "string"
                            },
                            {
                                "index": 2,
                                "type": "string"
                            },
                            {
                                "index": 3,
                                "type": "string"
                            },
                            {
                                "index": 4,
                                "type": "string"
                            },
                            {
                                "index": 5,
                                "type": "string"
                            },
                            {
                                "index": 6,
                                "type": "string"
                            },
                            {
                                "index": 7,
                                "type": "string"
                            },
                            {
                                "index": 8,
                                "type": "string"
                            },
                            {
                                "index": 9,
                                "type": "string"
                            },
                            {
                                "index": 10,
                                "type": "string"
                            },
                            {
                                "index": 11,
                                "type": "string"
                            },
                            {
                                "index": 12,
                                "type": "string"
                            },
                            {
                                "index": 13,
                                "type": "string"
                            },
                            {
                                "index": 14,
                                "type": "string"
                            },
                            {
                                "index": 15,
                                "type": "string"
                            },
                            {
                                "index": 16,
                                "type": "string"
                            },
                            {
                                "index": 17,
                                "type": "string"
                            },
                            {
                                "index": 18,
                                "type": "string"
                            },
                            {
                                "index": 19,
                                "type": "string"
                            },
                            {
                                "index": 20,
                                "type": "string"
                            },
                            {
                                "index": 21,
                                "type": "string"
                            },
                            {
                                "index": 22,
                                "type": "string"
                            },
                            {
                                "index": 23,
                                "type": "string"
                            },
                            {
                                "index": 24,
                                "type": "string"
                            },
                            {
                                "index": 25,
                                "type": "string"
                            },
                            {
                                "index": 26,
                                "type": "string"
                            },
                            {
                                "index": 27,
                                "type": "string"
                            },
                            {
                                "index": 28,
                                "type": "string"
                            },
                            {
                                "index": 29,
                                "type": "string"
                            },
                            {
                                "index": 30,
                                "type": "string"
                            },
                            {
                                "index": 31,
                                "type": "string"
                            },
                            {
                                "index": 32,
                                "type": "string"
                            },
                            {
                                "index": 33,
                                "type": "string"
                            },
                            {
                                "index": 34,
                                "type": "string"
                            },
                            {
                                "index": 35,
                                "type": "string"
                            },
                            {
                                "index": 36,
                                "type": "string"
                            },
                            {
                                "index": 37,
                                "type": "string"
                            },
                            {
                                "index": 38,
                                "type": "string"
                            },
                            {
                                "index": 39,
                                "type": "string"
                            },
                            {
                                "index": 40,
                                "type": "string"
                            },
                            {
                                "index": 41,
                                "type": "string"
                            },
                            {
                                "index": 42,
                                "type": "string"
                            },
                            {
                                "index": 43,
                                "type": "string"
                            },
                            {
                                "index": 44,
                                "type": "string"
                            },
                            {
                                "index": 45,
                                "type": "string"
                            },
                            {
                                "index": 46,
                                "type": "string"
                            },
                            {
                                "index": 47,
                                "type": "string"
                            },
                            {
                                "index": 48,
                                "type": "string"
                            },
                            {
                                "index": 49,
                                "type": "string"
                            },
                            {
                                "index": 50,
                                "type": "string"
                            },
                            {
                                "index": 51,
                                "type": "string"
                            },
                            {
                                "index": 52,
                                "type": "string"
                            },
                            {
                                "index": 53,
                                "type": "string"
                            },
                            {
                                "index": 54,
                                "type": "string"
                            },
                            {
                                "index": 55,
                                "type": "string"
                            },
                            {
                                "index": 56,
                                "type": "string"
                            },
                            {
                                "index": 57,
                                "type": "string"
                            },
                            {
                                "index": 58,
                                "type": "string"
                            },
                            {
                                "index": 59,
                                "type": "string"
                            },
                            {
                                "index": 60,
                                "type": "string"
                            },
                            {
                                "index": 61,
                                "type": "string"
                            },
                            {
                                "index": 62,
                                "type": "string"
                            },
                            {
                                "index": 63,
                                "type": "string"
                            },
                            {
                                "index": 64,
                                "type": "string"
                            },
                            {
                                "index": 65,
                                "type": "string"
                            },
                            {
                                "index": 66,
                                "type": "string"
                            },
                            {
                                "index": 67,
                                "type": "string"
                            },
                            {
                                "index": 68,
                                "type": "string"
                            },
                            {
                                "index": 69,
                                "type": "string"
                            },
                            {
                                "index": 70,
                                "type": "string"
                            },
                            {
                                "index": 71,
                                "type": "string"
                            },
                            {
                                "index": 72,
                                "type": "string"
                            },
                            {
                                "index": 73,
                                "type": "string"
                            },
                            {
                                "index": 74,
                                "type": "string"
                            },
                            {
                                "index": 75,
                                "type": "string"
                            },
                            {
                                "index": 76,
                                "type": "string"
                            },
                            {
                                "index": 77,
                                "type": "string"
                            },
                            {
                                "index": 78,
                                "type": "string"
                            },
                            {
                                "index": 79,
                                "type": "string"
                            },
                            {
                                "index": 80,
                                "type": "string"
                            },
                            {
                                "index": 81,
                                "type": "string"
                            },
                            {
                                "index": 82,
                                "type": "string"
                            },
                            {
                                "index": 83,
                                "type": "string"
                            },
                            {
                                "index": 84,
                                "type": "string"
                            },
                            {
                                "index": 85,
                                "type": "string"
                            },
                            {
                                "index": 86,
                                "type": "string"
                            },
                            {
                                "index": 87,
                                "type": "string"
                            },
                            {
                                "index": 88,
                                "type": "string"
                            },
                            {
                                "index": 89,
                                "type": "string"
                            },
                            {
                                "index": 90,
                                "type": "string"
                            },
                            {
                                "index": 91,
                                "type": "string"
                            },
                            {
                                "index": 92,
                                "type": "string"
                            },
                            {
                                "index": 93,
                                "type": "string"
                            },
                            {
                                "index": 94,
                                "type": "string"
                            },
                            {
                                "index": 95,
                                "type": "string"
                            },
                            {
                                "index": 96,
                                "type": "string"
                            },
                            {
                                "index": 97,
                                "type": "string"
                            },
                            {
                                "index": 98,
                                "type": "string"
                            }
                        ],
                        "fieldDelimiter": "|@|",
                        "fileFormat": "dat",
                        "nullFormat": "^(\\s*|\\s*\\.\\s*|null)$"
                    }
                },
                "writer": {
                    "name": "mysqlwriter",
                    "parameter": {
                        "username": "root",
                        "password": "Iamzqykj1!",
                        "writeMode": "insert",
                        "column": [
                            "Crm_Type"
                            ,"ANTMYLNDG_RPT_ID"
                            ,"Scn_Type"
                            ,"TX_ID"
                            ,"CUST_NO"
                            ,"TX_DT"
                            ,"DETAIL_SOURCE"
                            ,"BIZ_TYPE"
                            ,"BIZ_LINE"
                            ,"REPORT_BIZ_LINE"
                            ,"DETAIL_NUM"
                            ,"TERM_CURR_IND"
                            ,"ACCT_CARD_IND"
                            ,"CUST_ACCT_NUM"
                            ,"CUST_NAME"
                            ,"CUST_IND"
                            ,"CUST_AGE"
                            ,"IC_CARD_CURR_TYPE"
                            ,"CURRENCY_CD"
                            ,"DEPOSIT_TYPE"
                            ,"SALE_PRODUCT_ID"
                            ,"FUND_USE_CD"
                            ,"CUST_TYPE_CD"
                            ,"TX_TM"
                            ,"TX_AMT"
                            ,"TX_AMT_RMB"
                            ,"TX_AMT_USD"
                            ,"CREDIT_DEBIT_IND"
                            ,"RECEIVE_PAY_IND"
                            ,"TX_TYPE"
                            ,"TX_METHOD"
                            ,"REMIT_TYPE"
                            ,"TX_CHANNEL_TYPE"
                            ,"TX_DEAL_NUM"
                            ,"OVRLSTTN_EV_TRCK_NO"
                            ,"TELLER_NO"
                            ,"TX_CD"
                            ,"TX_ORG"
                            ,"TX_ORG_NAME"
                            ,"TX_AREA"
                            ,"TX_NATION_CD"
                            ,"TX_DIR"
                            ,"CRED_NUM"
                            ,"CRED_TYPE"
                            ,"ABSTRACT_CD"
                            ,"ABSTRACT_DESC"
                            ,"ACCT_ATTR"
                            ,"ACCT_TYPE"
                            ,"FUND_PURPOSE"
                            ,"OPEN_ORG"
                            ,"OPEN_ORG_NAME"
                            ,"OPEN_ORG_DISTRICT_CD"
                            ,"FXQ_ORG"
                            ,"FXQ_ORG_NAME"
                            ,"OPEN_DT"
                            ,"CLOSE_DT"
                            ,"LAST_TX_DETAIL_DT"
                            ,"PRODUCT_TYPE"
                            ,"CNTER_SYS_ACCT_NUM"
                            ,"CNTER_ACCT_MODI_NUM"
                            ,"CNTER_ACCT_TYPE"
                            ,"CNTER_ACCT_ATTR"
                            ,"CNTER_CUST_IND"
                            ,"CNTER_CUST_ACCT_NUM"
                            ,"CNTER_CUST_NO"
                            ,"CNTER_CUST_NAME"
                            ,"CNTER_IN_OUT_BANK_IND"
                            ,"CNTER_CERT_NUM"
                            ,"CNTER_CERT_TYPE"
                            ,"CNTER_CERT_TYPE_DESC"
                            ,"CNTER_MERCHANT_NO"
                            ,"CNTER_MERCHANT_TYPE"
                            ,"CNTER_OPEN_ORG"
                            ,"CNTER_OPEN_ORG_DISTRICT_CD"
                            ,"CNTER_TERM_CURR_IND"
                            ,"CNTER_FIN_ORG_CD"
                            ,"CNTER_FIN_ORG_NAME"
                            ,"CNTER_FIN_ORG_DISTRICT_CD"
                            ,"CNTER_FIN_ORG_TYPE"
                            ,"CNTER_PARTY_NATISING2"
                            ,"TERMINAL_INFO"
                            ,"BT_FREE"
                            ,"ST_FREE"
                            ,"NST_FREE"
                            ,"AGENT_NAME"
                            ,"AGENT_CERT_TYPE"
                            ,"AGENT_CERT_TYPE_DESC"
                            ,"AGENT_CERT_NUM"
                            ,"AGENT_PHONE_NUM"
                            ,"AGENT_NATION"
                            ,"IS_AGENT_IND"
                            ,"IS_CROSS_TX_IND"
                            ,"STL_TYPE"
                            ,"IS_CROSS_BANK_IND"
                            ,"IS_REMOTE_IND"
                            ,"AGR_ORG"
                            ,"ACCOUNT_BAL"
                            ,"COMMENT1"
                            ,"COMMENT2"
                        ],
                        "session": [],
                        "preSql": [],
                        "connection": [
                            {
                                "jdbcUrl": "jdbc:mysql://172.30.6.191:3306/jsccb_test_data",
                                "table": ["test"]
                            }
                        ]
                    }
                }
            }
        ]
    }
}

zkkkkkkkkkkkkk
关注
  • 9
    点赞
  • 踩
  • 7
    收藏
    觉得还不错? 一键收藏
  • 0
    评论
专栏目录
datax 模板_datax模板
weixin_39782752的博客
12-21 711
DataX 是一个异构数据源离线同步工具，致力于实现包括关系型数据库(MySQL、Oracle等)、HDFS、Hive、ODPS、HBase、FTP等各种异构数据源之间稳定高效的数据同步功能。1. mysql2mysql.json{"job": {"setting": {"speed": {"channel": 1}},"content": [{"reader": {"name": "mysqlr...
datax 模板_datax实战
weixin_39902085的博客
12-21 511
一、全量同步1.简单字段同步本文以mysql -> mysql为示例：本次测试的表为mysql的系统库-sakila中的actor表，由于不支持目的端自动建表，此处预先建立目的表：CREATE TABLE`actor_copy` (`actor_id`smallint(5) unsigned NOT NULLAUTO_INCREMENT,`first_name`varchar(45) NOT...
datax 模板_Datax入门 - 阿伦哥的博客 - OSCHINA - 中文开源技术交流社区
weixin_32823993的博客
12-30 126
第一步、创建创业的配置文件(json格式)可以通过命令查看配置模板： python datax.py -r {YOUR_READER} -w {YOUR_WRITER}如：python datax.py -r streamreader -w streamwriterzlh@zlhdeMacBook-Pro:~/software/datax/bin$ python datax.py -r strea...
DataX-json模板(hdfsToMysql、hdfsToOracle、mysqlToHdfs、oracleToDoris、oracleToHDFS...)【全】
weixin_42326851的博客
04-25 668
DataX-json模板(hdfsToMysql、hdfsToOracle、mysqlToHdfs、oracleToDoris)【全】
datax同步模板.rar
09-24
datax安装包下载，下载之后直接解压即可用
datax数据迁移shell
08-26
依据时间字段增量 1、创建要迁移表的文件，文件和脚本在同一级目录，名称为: transfer.txt 2、文件格式为：表名+列名+开始时间+结束时间（以+隔开） 3、迁移数据 4、记录迁移信息到目的库
datax数据迁移插件-oscarreader
01-16
标题中的"datax数据迁移插件-oscarreader"指的是DataX中的一个特定插件，用于数据迁移操作，专门针对奥斯卡（Oscar）数据库进行数据读取。DataX是阿里巴巴开源的一款强大的大数据同步工具，它能够支持多种数据源之间...
datax数据同步部署笔记
最新发布
06-28
### DataX 数据同步部署知识点详解 #### 一、DataX简介 DataX 是一款轻量级离线数据同步工具，支持多种异构数据源之间的高效数据同步。它由阿里巴巴集团开发并开源，广泛应用于大数据处理场景下的数据迁移、ETL等...
DataX使用测试数据csv
04-21
自己博客上用到的数据
datax数据迁移插件-db2writer
01-16
《DataX数据迁移插件-DB2Writer深度解析》 DataX是阿里巴巴开源的一款强大而高效的数据同步工具，它能够实现在多种数据存储之间进行数据迁移。在大数据领域，数据迁移是一项至关重要的任务，尤其在企业级应用中，...
datax数据迁移插件-db2reader
01-16
《DataX数据迁移插件——DB2Reader深度解析》 在大数据处理领域，高效、稳定的数据迁移是一项至关重要的任务。DataX作为阿里巴巴开源的一款强大、通用的数据同步工具，广泛应用于各种数据库之间的数据迁移。其中，...
datax数据同步异常问题检测
09-02
解析datax同步日志，标记出异常的Job信息。
DataX数据的迁移（MySQL、HDFS，Hive）
04-12
1.数据迁移的过程中，由于hive的Null值存储为"\N"，Mysql存储为NULL值，二者转换时需要注意，再数据迁移json模板中，"nullFormat": "\\N", 该配置信息就是解决了数据迁移是存在的Null值。 2.如果hive中没有数值DataX...
数据同步工具datax
10-11
linux datax 同步工具离线数据同步工具，实现包括 MySQL、Oracle、SqlServer、Postgre、HDFS、Hive、ADS、HBase、TableStore(OTS)、MaxCompute(ODPS)、DRDS 等各种异构数据源之间高效的数据同步功能。Github地址：...
datax数据从hive导入mysql数据缺失解决
01-18
### DataX 数据从 Hive 导入 MySQL 数据缺失解决 #### 背景介绍 在大数据处理领域，Hive 和 MySQL 分别作为数据仓库与关系型数据库的重要组成部分，在数据流转过程中承担着关键角色。Hive 通常用于存储海量数据并...
java从键盘读入多组输入
qq_40223083的博客
09-19 3728
java从键盘读入多组输入 从键盘读入数据，一般使用的是Scanner类，当需要处理多组数据时，该怎么处理呢。比如说下面这种输入 输入描述 多组数据，每组数据两行，其中： 1.第一行为一个整数n，表示数组的元素个数。 2.第二行为n个整数(1≤n≤100000),表示数组的每个元素,数据保证在int范 围内, 且数组中没有重复元素。 题目中的数据没有总组数，也没也结束符。其实是做不出来的，这里我主动为他加了个规则，读取每组数据的元素个数遇到-1时停止。 public List<Lis
Datax json模板集合
weixin_47444415的博客
11-27 1048
{ "job": { "setting": { "speed": { "channel": 6, "byte": 8048576, "record": 10000000 }, "errorLimit": { "record": 0, "percentage": 0.02 } }, "content": [ { "reader": { "n
【Datax同步】json模板
cui8483的博客
02-01 356
【Datax同步】json模板
DataX
我的笔记
03-15 1224
大数据自学笔记——DataX学习笔记
评论
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值