参考路径:https://github.com/alibaba/DataX
DATAX安装法一(简单):
环境准备:jdk1.8以上,python2.6以上,apache maven 3.x( Compile DataX )
下载datax地址:http://datax-opensource.oss-cn-hangzhou.aliyuncs.com/datax.tar.gz
1.上传datax.tar.gz到soft目录并解压: tar -zxvf datax.tar.gz
2.删除安装包: rm -rf datax.tar.gz
3.进入bin目录,即可运行同步作业 :cd datax/bin
运行: python /soft/datax/bin/datax.py /soft/datax/job/job.json
参考路径:linux:https://github.com/WeiYe-Jing/datax-web/blob/master/doc/datax-web/datax-web-deploy.md
DATAX_Web在centos7上安装:
1.上传文件到soft目录并解压:
解压文件: tar -zxvf datax-web-2.1.2.tar.gz
删除安装包: rm -rf datax-web-2.1.2.tar.gz
2.执行一键安装脚本进入解压后的目录,找到bin目录下面的install.sh文件,如果选择交互式的安装,则直接执行
进入: cd datax-web-2.1.2/bin
执行:./install.sh
2021-05-09 03:22:16.521 [INFO] (5555) Creating directory: [/soft/datax-web-2.1.2/bin/../modules].
2021-05-09 03:22:16.542 [INFO] (5555) ####### Start To Uncompress Packages ######
2021-05-09 03:22:16.548 [INFO] (5555) Uncompressing....
Do you want to decompress this package: [datax-admin_2.1.2_1.tar.gz]? (Y/N)y
2021-05-09 03:22:37.975 [INFO] (5555) Uncompress package: [datax-admin_2.1.2_1.tar.gz] to modules directory
Do you want to decompress this package: [datax-executor_2.1.2_1.tar.gz]? (Y/N)y
2021-05-09 03:22:48.661 [INFO] (5555) Uncompress package: [datax-executor_2.1.2_1.tar.gz] to modules directory
2021-05-09 03:22:49.254 [INFO] (5555) ####### Finish To Umcompress Packages ######
Scan modules directory: [/soft/datax-web-2.1.2/bin/../modules] to find server under dataxweb
2021-05-09 03:22:49.260 [INFO] (5555) ####### Start To Install Modules ######
2021-05-09 03:22:49.263 [INFO] (5555) Module servers could be installed:
[datax-admin] [datax-executor]
Do you want to confiugre and install [datax-admin]? (Y/N)y
2021-05-09 03:22:57.679 [INFO] (5555) Install module server: [datax-admin]
Start to make directory
2021-05-09 03:22:57.747 [INFO] (5621) Start to build directory
2021-05-09 03:22:57.752 [INFO] (5621) Creating directory: [/soft/datax-web-2.1.2/modules/datax-admin/bin/../logs].
2021-05-09 03:22:57.807 [INFO] (5621) Directory or file: [/soft/datax-web-2.1.2/modules/datax-admin/bin/../conf] has been exist
2021-05-09 03:22:57.811 [INFO] (5621) Creating directory: [/soft/datax-web-2.1.2/modules/datax-admin/bin/../data].
end to make directory
Start to initalize database
Do you want to confiugre and install [datax-executor]? (Y/N)y
2021-05-09 03:23:05.933 [INFO] (5555) Install module server: [datax-executor]
2021-05-09 03:23:05.954 [INFO] (5656) Start to build directory
2021-05-09 03:23:05.957 [INFO] (5656) Creating directory: [/soft/datax-web-2.1.2/modules/datax-executor/bin/../logs].
2021-05-09 03:23:05.988 [INFO] (5656) Directory or file: [/soft/datax-web-2.1.2/modules/datax-executor/bin/../conf] has been exist
2021-05-09 03:23:05.991 [INFO] (5656) Creating directory: [/soft/datax-web-2.1.2/modules/datax-executor/bin/../data].
2021-05-09 03:23:06.021 [INFO] (5656) Creating directory: [/soft/datax-web-2.1.2/modules/datax-executor/bin/../json].
2021-05-09 03:23:06.050 [INFO] (5555) ####### Finish To Install Modules ######
mysql库地址:
进入路径:cd /datax-web-2.1.2/modules/datax-admin/conf
vi bootstrap.properties
此处mysql是本地服务器mysql:修改C:\Windows\System32\drivers\etc\hosts文件 加入如下语句:192.168.1.4 oracle
DB_HOST=oracle
DB_PORT=3306
DB_USERNAME=liuchao
DB_PASSWORD=liuchao
DB_DATABASE=datax_web
启动:./start-all.sh
2021-05-09 04:05:14.685 [INFO] (5930) Try To Start Modules In Order
2021-05-09 04:05:14.694 [INFO] (5938) ####### Begin To Start Module: [datax-admin] ######
2021-05-09 04:05:14.705 [INFO] (5946) load environment variables
2021-05-09 04:05:16.298 [INFO] (5946) /soft/jdk1.8.0_181/bin/java
2021-05-09 04:05:16.301 [INFO] (5946) Waiting DATAX-ADMIN to start complete ...
2021-05-09 04:05:16.800 [INFO] (5946) DATAX-ADMIN start success
2021-05-09 04:05:16.850 [INFO] (6134) ####### Begin To Start Module: [datax-executor] ######
2021-05-09 04:05:16.914 [INFO] (6142) load environment variables
2021-05-09 04:05:18.516 [INFO] (6142) /soft/jdk1.8.0_181/bin/java
2021-05-09 04:05:18.551 [INFO] (6142) Waiting DATAX-EXEXUTOR to start complete ...
2021-05-09 04:05:19.377 [INFO] (6142) DATAX-EXEXUTOR start success
开放端口号:
firewall-cmd --zone=public --add-port=9527/tcp --permanent
firewall-cmd --zone=public --add-port=9999/tcp --permanent
firewall-cmd --reload
查看运行情况:
ps -ef|grep java
root 7377 1 46 04:31 pts/0 00:00:14 /soft/jdk1.8.0_181/bin/java -Xms2g -Xmx2g -XX:+HeapDumpOnOutOfMemoryError -Dfile.encoding=UTF-8 -XX:HeapDumpPath=/soft/datax-web-2.1.2/modules/datax-admin/bin/../logs -Dlog.path=/soft/datax-web-2.1.2/modules/datax-admin/bin/../logs -Duser.dir=/soft/datax-web-2.1.2/modules/datax-admin/bin/../ -Dserver.port=9527 -Ddata.path=/soft/datax-web-2.1.2/modules/datax-admin/bin/../data -Dmail.username=datax -Dmail.password=123456 -Dlogging.config=/soft/datax-web-2.1.2/modules/datax-admin/bin/../conf/logback.xml -classpath /soft/datax-web-2.1.2/modules/datax-admin/bin/../lib/*:/soft/datax-web-2.1.2/modules/datax-admin/bin/../conf:. com.wugui.datax.admin.DataXAdminApplication
root 7632 1 37 04:31 pts/0 00:00:11 /soft/jdk1.8.0_181/bin/java -Xms2g -Xmx2g -XX:+HeapDumpOnOutOfMemoryError -Dfile.encoding=UTF-8 -XX:HeapDumpPath=/soft/datax-web-2.1.2/modules/datax-executor/bin/../logs -Dlog.path=/soft/datax-web-2.1.2/modules/datax-executor/bin/../logs -Duser.dir=/soft/datax-web-2.1.2/modules/datax-executor/bin/../ -Dserver.port=9504 -Ddata.path=/soft/datax-web-2.1.2/modules/datax-executor/bin/../data -Dexecutor.port=9999 -Djson.path=/soft/datax-web-2.1.2/modules/datax-executor/bin/../json -Dpython.path= -Ddatax.admin.port=9527 -Dlogging.config=/soft/datax-web-2.1.2/modules/datax-executor/bin/../conf/logback.xml -classpath /soft/datax-web-2.1.2/modules/datax-executor/bin/../lib/*:/soft/datax-web-2.1.2/modules/datax-executor/bin/../conf:. com.wugui.datax.executor.DataXExecutorApplication
root 7726 6550 1 04:31 pts/0 00:00:00 grep --color=auto java
最终运行:
http://192.168.189.19:9527/index.html 用户密码:admin 123456