1、dolphinscheduler与datax集成环境变量配置
export JAVA_HOME=/opt/soft/java
export PYTHON_HOME=/usr/bin/python
export DATAX_HOME=/opt/soft/datax
export PATH=$PYTHON_HOEM:$DATAX_HOME/bin:$JAVA_HOME/bin:$PATH
截图如下:
注意服务器上安装python2.7,以及datax安装在对应目录下。
2、同步mongodb 到doris
{
"job": {
"content": [
{
"reader": {
"name": "mongodbreader",
"parameter": {
"address": ["xxx:27017","xxxx:27017","xxxx:27017"],
"collectionName": "leases",
"column": [
{
"name":"_id",
"type":"string"
},
{
"name":"id",
"type":"string"
},
{
"name":"storeid",
"type":"string"
},
{
"name":"storename",