![](https://img-blog.csdnimg.cn/20201014180756757.png?x-oss-process=image/resize,m_fixed,h_64,w_64)
datax
docsz
擅长大数据平台架构,数仓设计,数据湖落地;构建企业级数据平台
展开
-
Java执行Datax脚本-MySQL写入Doris
Java执行Datax脚本-MySQL写入Doris。原创 2023-02-06 18:49:27 · 1027 阅读 · 0 评论 -
DataX读取Hive表写入Oracle之orc存储格式
1、脚本{ "job": { "content": [{ "reader": { "name": "hdfsreader", "parameter": { "column": [ { "index": 0, "type": "STRING" }, { "index": 1, "type": "STRING" }, { "index": 2,原创 2022-04-21 14:11:39 · 2323 阅读 · 0 评论 -
DataX读取Oracle写入Hive之orc存储格式
1、脚本{ "core": { "transport": { "channel": { "speed": { "byte": 10485760, "record": 100000 } } } }, "job": { "content": [{ "reader": { "name": "oraclereader", "parameter": { "column": [ "BJBH", "原创 2022-04-21 14:07:47 · 2648 阅读 · 0 评论 -
DataX从Hive将数据写入Oracle
DataX从Hive将数据写入Oracle原创 2022-04-13 19:55:36 · 2482 阅读 · 0 评论 -
DataX从MySQL写入MongoDB
DataX从MySQL写入MongoDB原创 2022-04-08 17:20:53 · 1919 阅读 · 1 评论 -
DataX支持MySQL-8读写
datax原创 2022-04-08 15:23:00 · 2586 阅读 · 1 评论 -
DataX源码编译
1、下载源码git clone git@github.com:alibaba/DataX.git2、修改TSDBWriter类2.1、修改pom依赖 <!-- tsdb --> <dependency> <groupId>com.aliyun</groupId> <artifactId>hitsdb-client</artifactId><原创 2022-04-08 14:32:21 · 968 阅读 · 0 评论 -
DataX之Hive写入MySQL的NULL值处理
1、Hive建表CREATE TABLE `rcdn_ads.ads_rcdn_zc_xq`( `qybm` varchar(25) COMMENT '区域编码', `csbm` varchar(25) COMMENT '城市编码', `shengbm` varchar(25) COMMENT '省份编码', `cybm` varchar(25) COMMENT '产业编码', `zclxbm` varchar(25) COMMENT '政策类型编码', `zcztbm`原创 2022-03-09 15:07:04 · 3825 阅读 · 0 评论 -
DataX-MySQL-to-Oracle
1、脚本 { "job": { "content":[ { "reader":{ "name":"mysqlreader", "parameter":{ "connection":[ { "jdbcUrl":[ "jdbc:mysql://node03:3306/metadata" ], "querySql":[ "select * from t_dat原创 2022-02-22 16:12:40 · 782 阅读 · 0 评论 -
DataX-MySQL-to-Hive之Hadoop HA
1、脚本{ "setting": {}, "job": { "setting": { "speed": { "channel": 2 } }, "content": [ { "reader": { "name": "mysqlreader", "para原创 2022-02-22 16:08:32 · 255 阅读 · 0 评论 -
DataX之type-value配置Hive-to-MySQL
1、脚本{ "job": { "setting": { "speed": { "channel": 3 } }, "content": [ { "reader": { "name": "hdfsreader", "parameter":原创 2022-02-22 16:04:05 · 275 阅读 · 0 评论 -
DataX之Hive-to-MySQL
1、脚本{ "job": { "setting": { "speed": { "channel": 3 } }, "content": [ { "reader": { "name": "hdfsreader", "parameter":原创 2022-02-22 15:58:48 · 974 阅读 · 0 评论 -
DataX之MySQL-overwrite-HIVE
1、json脚本{ "job": { "setting": { "speed": { "channel": 3 }, "cipher": { "sfjm": "Y", "instance": "AES128" }, "errorLimit": { "record": "-1" } }, "content": [{ "reader":原创 2021-12-06 15:55:49 · 2029 阅读 · 2 评论 -
DataX之MySQL-append-Hive
1、mysql-to-hive.json{ "setting": {}, "job": { "setting": { "speed": { "channel": 2 } }, "content": [ { "reader": { "name": "mysqlreader", "parameter": { "username": "root", "password": "123456", "connec原创 2021-12-06 15:49:20 · 1364 阅读 · 0 评论 -
DataX之读取MySQL数据
1、编写read-mysql.json脚本{“job”: {“setting”: {“speed”: {“channel”:1}},“content”: [{“reader”: {“name”: “mysqlreader”,“parameter”: {“username”: “用户名”,“password”: “密码”,“connection”: [{“querySql”: [“select * from emp_base_info where emp_city_code原创 2021-04-30 14:57:30 · 804 阅读 · 1 评论 -
DataX之读取Oracle数据
1、编写脚本read-oracle.json{“job”: {“setting”: {“speed”: {“byte”: 1048576},“errorLimit”: {“record”: 0,“percentage”: 0.02}},“content”: [{“reader”: {“name”: “oraclereader”,“parameter”: {“username”: “用户名”,“password”: “密码”,“column”: [“ID”,“DYLYL原创 2021-04-30 15:01:19 · 1242 阅读 · 1 评论 -
DataX之MySQL数据写入Hive
1、编写脚本mysql-to-hive.json{ "job": { "setting": { "speed": { "channel": 3 }, "errorLimit": { "record": 0, "percentage": 0.02 } }, "c原创 2021-04-30 15:12:54 · 1922 阅读 · 1 评论 -
DataX之读写Oracle数据
1、编写脚本oracle-to-oracle.json{ "job": { "setting": { "speed": { "channel": 1 } }, "content": [ { "reader": { "name": "oraclereader",原创 2021-04-30 15:24:50 · 1319 阅读 · 1 评论