新版ZCBUS安装步骤与数据同步

• 安装包：zcbus.server_full.docker.v2.0.1.X86_64.test.tar.gz

• 环境信息：CentOS Linux release 7.9.2009
  Linux zcbus 3.10.0-1160.el7.x86_64 #1 SMP Mon Oct 19 16:18:59 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux

• IP:192.168.71.153

• 实际解压目录：/soft/server_full

1、安装环境要求

内容	要求
操作系统版本	Linux 7 以上
防火墙	关闭
seLinux	关闭
磁盘空间	缓存目录建议同步数据库大小的 70%

2、环境准备

# 安装包版本
zcbus.server_full.docker.v2.0.1.X86_64.test.tar.gz
# 解压
tar -xzvf zcbus.simple_server.docker.v2.0.1.tar.gz

3、安装

1、进入到软件解压目录
cd /soft/server_full
2、使用zcmgr.sh安装软件（可使用zcmgr.sh --help查看帮助）
[root@zcbus server_full]# ./zcmgr.sh --help
➜ Usage :
➜ ==================================================================
➜   >>> Version 7.0.1. copyright (C) 2021 Zcbus. inc. <<<
➜ ==================================================================
➜      start   [servername/all]  : for start zcbus server .
➜      check   [servername/all]  : for check zcbus server process .
➜      stop    [servername/all]  : for stop zcbus server .
➜      restart [servername/all]  : for restart zcbus server .
➜      add     [zcbus/zcbus_full] [servername]        : for add one zcbus server .
➜      drop    [servername] [purge]: for drop one zcbus server ,when purge then first stop server and drop servername .
➜      list                      : for list zcbus server ...
➜      lslog   [servername]      : for display logs file for container ,default is zcbus
➜      log     [servername] [logfile]  : for display logs file for container ,default is zcbus
➜      detail  [servername]        : for list zcbus server ...
➜      install                   : for status one zcbus server ,is client/api/server/external .
➜      uninstall                  : for status one zcbus server ,default is all server .
➜      slient  /home/zcbus/zcbus.rsp : for install client by slient.

3、安装过程及说明：
[root@zcbus server_full]# ./zcmgr.sh install  # 执行安装命令
[Step 1]: checking OS version/firewalld/seLinux  and config ...
# 安装前系统参数检查/修改，过程已省略
############################## CHECK RESULT ##########################################################
➜ OK : 26 ERROR : 0 WARNING : 0
[INFO] whether to start install zcbus ... Please input 'y/Y' to continue/press Ctrl+C to exit :y  # 是否开始安装zcbus
[INFO] whether to install chinese[0]/english[1],defaut is 0: # 选择安装语言
[INFO] whether to install integrate/external ,defaut is integrate:  # 选择安装模式(一般默认即可)
####################install module####################
.......................................[ server ]
.......................................[ client ]
.......................................[ server_full ]
.......................................[ client_full ]
.......................................[ cloud_server ]
.......................................[ cloud_client ]
.......................................[ cloud_push ]
Please input Select Mode,default mode is [ server ]:  # 选择安装的服务模式(默认选择service即可)

[Step 2]: ready for data dir path ...
[INFO] Please input docker path /data/docker02:/docker
➜ Find path /docker
➜ Ready Path for /docker finished ...

[Step 3]: checking if docker is installed ...
➜ unzip soft/docker-20.10.10.tgz ...
docker/
docker/dockerd
docker/docker-init
docker/runc
docker/ctr
docker/containerd-shim-runc-v2
docker/containerd-shim
docker/docker
docker/containerd
docker/docker-proxy
Created symlink from /etc/systemd/system/multi-user.target.wants/docker.service to /etc/systemd/system/docker.service.
Docker version 20.10.10, build b485636
############################## docker version: 20.10.10 ##############################################

[Step 4]: checking docker-compose is installed ...

Install docker-compose ...
docker-compose version 1.25.0-rc4, build 8f3c9c58
############################## docker-compose version: 1.25.0 ########################################

[Step 5]: checking mysql directory ...
############################## Create directory mysql /docker/zcbusdata .... #########################
✔ Mysql data directory  /docker/zcbusdata/mysql/data create Successful! 

[Step 6]: checking kafka directory ...
############################## Create directory kafka /docker/zcbusdata/kafka .... ###################
✔ Kafka data directory /docker/zcbusdata/zcbuskafka/logs create Successful! 

[Step 7]: checking cache directory ...
############################## Create directory cache /docker/zcbusdata .... #########################
✔ Mysql data directory  /docker/zcbusdata/cache create Successful! 

[Step 8]: checking zookeeper directory ...
############################## Create directory kafka /docker/zcbusdata/kafka .... ###################
✔ Zookeeoer data directory /docker/zcbusdata/zcbuszookeeper/data create Successful! 

[Step 9]: loading zcbus images ...
[INFO] Please input if load images y/n:y # 是否挂载镜像文件
docker load -i /soft/server_full/soft/zcbus.tar.gz
# 挂载镜像文件过程已省略
Loaded image: reg.zbomc.com/zcbus_zookeeper:v2.0.1
➜ Load images to docker's sucessfull...
➜ 
3e27923ad8f3d6ee560163abb26968465775c2cc966223059f23d956cc8bec08
➜ network zcbus is create sucessfull...
Check hostname [zcbus]'s ip is :[zcbus]
ready basic info ...
Finish init basic ...
➜ prepare server Sucessfull...
➜ 
➜ 

[Step 10]: checking if ports is used ...
➜ Port  33060 is available!!
➜ Port  8890 is available!!

[Step 11]: ready basic soft for container ...
➜ Ready compare soft ...
➜ Read zcbusserver jdk sucessfull....
➜ Read zcbusserver jar sucessfull....
➜ Read zcbusserver bin sucessfull....
➜ Read zcbusserver lib sucessfull....
➜ /docker/module/lib to /docker/zcbusdata/zcbusserver/ is build sucessfull...
➜ /docker/module/bin to /docker/zcbusdata/zcbusserver/ is build sucessfull...
➜ /docker/module/jdk to /docker/zcbusdata/zcbusserver/ is build sucessfull...
➜ /docker/module/jar to /docker/zcbusdata/zcbusserver/ is build sucessfull...

[Step 12]: starting zcbus ...
Creating zcbusnet       ... done
Creating zcbusrestapi   ... done
Creating zcbuszookeeper ... done
Creating zcbusvue       ... done
Creating zcbusdb        ... done
Creating zcbuskafka     ... done

====>>>ZCBUS [ Sat Jan 28 18:11:57 CST 2023 ]
     Name                   Command               State                      Ports                    
------------------------------------------------------------------------------------------------------
zcbusdb          docker-entrypoint.sh /run.sh     Up      3306/tcp, 33060/tcp                         
zcbuskafka       docker-entrypoint.sh             Up                                                  
zcbusnet         sh /run.sh                       Up      0.0.0.0:33060->33060/tcp,:::33060->33060/tcp
zcbusrestapi     sh /run.sh                       Up      7080/tcp                                    
zcbusvue         /docker-entrypoint.sh /bin ...   Up      0.0.0.0:8890->80/tcp,:::8890->80/tcp        
zcbuszookeeper   docker-entrypoint.sh             Up                                                  
➜ 

[Step 12]: sync zcbus_docker to /docker/...
copy /soft/server_full/bin /docker/...

[Step 12]: ready basic soft for basic zcbus_docker server ...
Check hostname [zcbus]'s ip is :[zcbus]

Note: add zcbus_docker service
sed "s#Z_HOME#/docker#g;s#Z_IP#zcbus#g;" /soft/server_full/common/zcbus_docker.service
? add zcbus_docker service successfully ...
grep db_external_port /soft/server_full/common/zcbus.yml|awk -F : '{print }' |sed 's/ //g'
➜ Read Master database info to /soft/server_full/config/zcbus_master.ini
➜ sdbinfo :QFlYT0k6/e0twWGp8aVtWfGB8dn9YdTo@zcbusnet:33060/zcbus...
➜ sync basic info to /docker/ begin ...
copy /soft/server_full/bin /docker/...
copy /soft/server_full/config /docker/...
copy /soft/server_full/yaml /docker/...
copy /soft/server_full/common /docker/...
copy /soft/server_full/zcmgr.sh /docker/...
copy /soft/server_full/soft/docker-20.10.10.tgz /docker/soft/...
copy /soft/server_full/soft/docker-compose-Linux-x86_64 /docker/soft/...
copy /soft/server_full/soft/zcbus /docker/soft/...
➜ sync basic info to /docker/ end ...
[LV0] 2023-01-28 18:12:28: connect to mysql zcbus/***@zcbus:33060 ...
[INF] set client character set utf8mb4...
[INF] new client character set: utf8mb4
[INF] MYSQL VERSION: 50732
[INF] MYSQL INFO: 5.7.32-log
SET SESSION sql_mode='ONLY_FULL_GROUP_BY,STRICT_TRANS_TABLES,ERROR_FOR_DIVISION_BY_ZERO,NO_ENGINE_SUBSTITUTION'
[INF] connection test ok.
➜ Test zcbus_docker Connect to zcbus_master.ini Sucessfull...
➜ =========================== ready restart zcbus_docker ====================
zcbus_docker is Stopping ...
zcbus_docker is Finished ...
config file zcbus.ini not exist, use zcbus_master.ini.
2023-01-28 18:12:28: exec -> ln -s /docker/config/zcbus_master.ini /docker/config/zcbus.ini
zcbus_host=zcbus
zcbus_port=33060
zcbus_user=******
zcbus_password=******
zcbus_db=zcbus

➜ sync config info to /docker/ begin ...
copy /soft/server_full/config /docker/...
copy /soft/server_full/yaml /docker/...
➜ sync config info to /docker/ end ...
➜ =============================================================
➜ Manager console Website Address: http://zcbus:8890
➜ Default login account : admin
➜ Default login password: 123456
➜ 
➜ =============================================================
✔ ----Zcbus has been installed and started successfully.----
➜ Ready compare soft ...
➜ /docker/module/lib to /docker/zcbusdata/zcbus/ is build sucessfull...
➜ /docker/module/bin to /docker/zcbusdata/zcbus/ is build sucessfull...
➜ /docker/module/jdk to /docker/zcbusdata/zcbus/ is build sucessfull...
➜ /docker/module/jar to /docker/zcbusdata/zcbus/ is build sucessfull...
Check hostname [zcbus]'s ip is :[zcbus]
Flush data to /compose_location/docker-compose.yml
zcbusvue is up-to-date
zcbusnet is up-to-date
zcbusrestapi is up-to-date
zcbusdb is up-to-date
zcbuszookeeper is up-to-date
zcbuskafka is up-to-date
Creating zcbus ... done

====>>>ZCBUS [ Sat Jan 28 18:12:36 CST 2023 ]
     Name                   Command               State                      Ports                    
------------------------------------------------------------------------------------------------------
zcbus            /bin/bash -c ${ZCBUS_HOME} ...   Up                                                  
zcbusdb          docker-entrypoint.sh /run.sh     Up      3306/tcp, 33060/tcp                         
zcbuskafka       docker-entrypoint.sh             Up                                                  
zcbusnet         sh /run.sh                       Up      0.0.0.0:33060->33060/tcp,:::33060->33060/tcp
zcbusrestapi     sh /run.sh                       Up      7080/tcp                                    
zcbusvue         /docker-entrypoint.sh /bin ...   Up      0.0.0.0:8890->80/tcp,:::8890->80/tcp        
zcbuszookeeper   docker-entrypoint.sh             Up                                                  
root       8785      1  1 18:12 pts/1    00:00:00 /docker/bin/zcbus_docker -log_level 2
➜ sync config info to /docker/ begin ...
copy /soft/server_full/config /docker/...
copy /soft/server_full/yaml /docker/...
➜ sync config info to /docker/ end ...
➜ =============================================================
➜ Manager console Website Address: http://zcbus:8890
➜ Default login account : admin
➜ Default login password: 123456
➜ 
➜ =============================================================
✔ ----Zcbus has been installed and started successfully.----
# 出现zcbus已成功安装并启动提示后，表示安装完成

4、界面操作

• 登录界面
  

4.1 添加容器

• 新增容器
  
• 验证新增成功
  

4.2 删除容器

• 删除
  

• 验证
  
  

4.3 添加发布节点

• 添加发布节点
  
• 添加数据库信息(用本地zcbus资料库进行测试)
  

4.4 添加订阅客户端

• 添加客户端
  
• 验证状态
  

4.5 分配同步策略

4.6 开启数据同步并完成数据比对

• 配置目标端数据库信息
  
• 订阅–数据表，勾选表后开启全量订阅
  

注：如果你想我一样用自己虚拟机来测试，需要注意下资源占用情况，程序在同步过程中进行ddl转换时会单独启动一个java进程，会消耗一部分资源。如果虚拟机资源有限，可能会导致订阅进程停止。
处理方式：增加虚拟机资源，重启进程后继续同步。或减少同步表，降低资源消耗。

• 开启同步
  
• 监控中确认同步完成
  
• 数据比对结果确认
  
  至此为止zcbus新版本安装步骤与同步操作说明已完成，免费版软件已经上线，有需要用到同步程序的各位请自取，有问题的话也可以私信我，希望可以帮到大家。