目录
前言
达梦数据库的数据守护(DM Data Watch)的实现原理:将主库产生的Redo日志传输到备库,备库接收并重新应用Redo日志,从而实现备库与主库的数据同步。数据守护的核心思想是监控数据库状态,获取主、备库数据同步情况,为Redo日志传输与重演过程中出现的各种异常情况提供一系列的解决方案。
本文针对达梦数据库的数据守护在虚拟机上完成搭建进行一次实践,并记录完整搭建过程。
一、环境准备
所需资源:
Oracle VM VirtualBox(虚拟机软件)
Kylin-Server-10-SP2-x86-Release-Build09-20210524.iso(麒麟操作系统软件)
dm8_20220525_x86_rh6_64.iso(达梦数据库软件)
服务器规划:
机器名 | IP地址 | 服务器角色 | 数据库实例名 | 说明 |
dameng01 | 192.168.56.101 | 主库 | GRP1_DM_01 | 安装麒麟系统,并安装达梦数据库软件及实例 |
dameng02 | 192.168.56.102 | 备库 | GRP1_DM_02 | 安装麒麟系统,并安装达梦数据库软件及实例 |
dameng03 | 192.168.56.103 | 监视器 | 安装麒麟系统,并安装达梦数据库软件 |
二、操作步骤
1.准备3台虚拟机
虚拟机规划:
镜像名 | 主机名 | 硬件配置 | 网卡 |
DM8_01 | dameng01 | 2C*3G*50G | 1个主机网络,1个NAT网络 |
DM8_02 | dameng02 | 2C*3G*50G | 1个主机网络,1个NAT网络 |
DM8_03 | dameng03 | 2C*3G*50G | 1个主机网络,1个NAT网络 |
安装虚拟机, 先安装一台麒麟系统虚拟机,然后复制出另外两台一样的虚拟机主机环境。
主机改名:hostname 主机名
2.数据库安装前准备
上传数据库安装软件镜像到三个节点的/opt/目录:
[root@dameng02 ~]# ll /opt|grep dm
-rw-r--r-- 1 root root 954251264 10月 6 13:47 dm8_20220525_x86_rh6_64.iso关闭主备库的
关闭主备库主机的防火墙:
[root@dameng01 ~]#systemctl stop firewalld
[root@dameng01 ~]#systemctl disable firewalld
3.数据库软件安装
在节点192.168.56.101、192.168.56.102、192.168.56.103上安装达梦数据库软件:
3.1 检查tmp空间 ,确保有2G的空间
[root@dameng01 ~]# df -h |grep /tmp
tmpfs 1.5G 16K 1.5G 1% /tmp
[root@dameng01 ~]# mount -o remount,size=2G /tmp
[root@dameng01 ~]# df -h |grep /tmp
tmpfs 2.0G 16K 2.0G 1% /tmp
3.2创建达梦数据库用户组及用户
[root@dameng01 ~]# groupadd dinstall
[root@dameng01 ~]# useradd -g dinstall dmdba
[root@dameng01 ~]# passwd dmdba
更改用户 dmdba 的密码 。
新的 密码:
重新输入新的 密码:
passwd:所有的身份验证令牌已经成功更新。
[root@dameng01 ~]# mkdir /dm8
[root@dameng01 ~]# chown dmdba:dinstall /dm8
[root@dameng01 ~]# ll / |grep dm8
drwxr-xr-x 2 dmdba dinstall 6 10月 6 13:56 dm8
3.3安装数据库软件
[root@dameng01 ~]# mount -o loop /opt/dm8_20220525_x86_rh6_64.iso /mnt
mount: /mnt: WARNING: source write-protected, mounted read-only.
[root@dameng01 ~]# su - dmdba
[dmdba@dameng01 ~]$ export DISPLAY=192.168.42.43:0.0
[dmdba@dameng01 ~]$ cd /mnt
[dmdba@dameng01 mnt]$ ./DMInstall.bin
解压安装程序........
根据图形界面提示用root用户执行脚本:
[root@dameng01 ~]# /dm8/script/root/root_installer.sh
移动 /dm8/bin/dm_svc.conf 到/etc目录
修改服务器权限
创建DmAPService服务
Created symlink /etc/systemd/system/multi-user.target.wants/DmAPService.service → /usr/lib/systemd/system/DmAPService.service.
创建服务(DmAPService)完成
启动DmAPService服务
4.数据库实例安装
在节点192.168.56.101、192.168.56.102上安装数据库实例。
实例端口规划:
IP | 数据库名 | 实例名 | PORT | INST_DW_PORT | MAL_PORT | MAL_DW_PORT |
192.168.56.101 | DMDW | GRP1_DM_01 | 5246 | 45101 | 55101 | 65101 |
192.168.56.102 | DMDW | GRP1_DM_02 | 5246 | 45102 | 55102 | 65102 |
使用达梦数据库实例安装界面引导一步步执行安装,
按照界面提示以root用户执行上面的脚本:
[root@dameng01 ~]# mv /dm8/bin/DmServiceGRP1_DM_01.service /usr/lib/systemd/system/DmServiceGRP1_DM_01.service
[root@dameng01 ~]# systemctl enable DmServiceGRP1_DM_01.service
Created symlink /etc/systemd/system/multi-user.target.wants/DmServiceGRP1_DM_01.service → /usr/lib/systemd/system/DmServiceGRP1_DM_01.service.
[root@dameng01 ~]# systemctl start DmServiceGRP1_DM_01.service
5.主备库数据库同步
节点192.168.56.101、192.168.56.102的数据库实例停止,对GRP1_DM_01脱机备份,还原到实例GRP1_DM_02.
5.1备份主库并复制备份数据到备库
[dmdba@dameng01 bin]$ ./dmrman
dmrman V8
RMAN> BACKUP DATABASE '/dm8/data/DMDW/dm.ini' FULL TO BACKUP_FILE1 BACKUPSET '/dm8/backup/BACKUP_FILE_01'
BACKUP DATABASE '/dm8/data/DMDW/dm.ini' FULL TO BACKUP_FILE1 BACKUPSET '/dm8/backup/BACKUP_FILE_01'
file dm.key not found, use default license!
Database mode = 0, oguid = 0
Normal of FAST
Normal of DEFAULT
Normal of RECYCLE
Normal of KEEP
Normal of ROLL
EP[0]'s cur_lsn[43637], file_lsn[43637]
Processing backupset /dm8/backup/BACKUP_FILE_01
[Percent:100.00%][Speed:0.00M/s][Cost:00:00:04][Remaining:00:00:00]
backup successfully!
time used: 00:00:06.289
RMAN> exit
time used: 0.268(ms)
[dmdba@dameng01 bin]$ scp -r /dm8/backup/BACKUP_FILE_01 root@192.168.56.1002:/dm8/backup
ssh: Could not resolve hostname 192.168.56.1002: Name or service not known
lost connection
[dmdba@dameng01 bin]$ scp -r /dm8/backup/BACKUP_FILE_01 root@192.168.56.102:/dm8/backup
The authenticity of host '192.168.56.102 (192.168.56.102)' can't be established.
ECDSA key fingerprint is SHA256:KdQqo3jHumA8H6zQbA2X3VxTEA8tmg+1WtaSVqZ4o5M.
Are you sure you want to continue connecting (yes/no/[fingerprint])? yes
Warning: Permanently added '192.168.56.102' (ECDSA) to the list of known hosts.
Authorized users only. All activities may be monitored and reported.
root@192.168.56.102's password:
BACKUP_FILE_01.bak 100% 7622KB 11.6MB/s 00:00
BACKUP_FILE_01.meta
5.2 还原备库
[dmdba@dameng02 bin]$$cp /dm8/backup/BACKUP_FILE_01/* /dm8/data/DMDW/bak
[dmdba@dameng02 bin]$ ./dmrman
dmrman V8
RMAN> RESTORE DATABASE '/dm8/data/DMDW/dm.ini' FROM BACKUPSET '/dm8/data/DMDW/bak'
RESTORE DATABASE '/dm8/data/DMDW/dm.ini' FROM BACKUPSET '/dm8/data/DMDW/bak'
Normal of FAST
Normal of DEFAULT
Normal of RECYCLE
Normal of KEEP
Normal of ROLL
[Percent:100.00%][Speed:0.00M/s][Cost:00:00:21][Remaining:00:00:00]
restore successfully.
time used: 00:00:22.364
RMAN> RECOVER DATABASE '/dm8/data/DMDW/dm.ini' FROM BACKUPSET '/dm8/data/DMDW/bak'
RECOVER DATABASE '/dm8/data/DMDW/dm.ini' FROM BACKUPSET '/dm8/data/DMDW/bak'
Database mode = 0, oguid = 0
Normal of FAST
Normal of DEFAULT
Normal of RECYCLE
Normal of KEEP
Normal of ROLL
EP[0]'s cur_lsn[43637], file_lsn[43637]
备份集[/dm8/data/DMDW/bak]备份过程中未产生日志
recover successfully!
time used: 879.548(ms)
RMAN> RECOVER DATABASE '/dm8/data/DMDW/dm.ini' UPDATE DB_MAGIC
RECOVER DATABASE '/dm8/data/DMDW/dm.ini' UPDATE DB_MAGIC
Database mode = 0, oguid = 0
Normal of FAST
Normal of DEFAULT
Normal of RECYCLE
Normal of KEEP
Normal of ROLL
EP[0]'s cur_lsn[43637], file_lsn[43637]
recover successfully!
time used: 00:00:01.885
RMAN>
6、设置配置文件参数
6.1设置主库配置文件
登陆主库主机192.168.56.101进行以下配置:
dm.ini
INSTANCE_NAME = GRP1_DM_01
PORT_NUM = 5246
DW_INACTIVE_INTERVAL = 60
ALTER_MODE_STATUS = 0
ENABLE_OFFLINE_TS = 2
MAL_INI = 1
ARCH_INI = 1
RLOG_SEND_APPLY_MON = 64
dmmal.ini
MAL_CHECK_INTERVAL = 5
MAL_CONN_FAIL_INTERVAL = 5
[MAL_INST1]
MAL_INST_NAME = GRP1_DM_01
MAL_HOST = 192.168.56.101
MAL_PORT = 55101
MAL_INST_HOST = 192.168.56.101
MAL_INST_PORT = 5246
MAL_DW_PORT = 65101
MAL_INST_DW_PORT = 45101
[MAL_INST2]
MAL_INST_NAME = GRP1_DM_02
MAL_HOST = 192.168.56.102
MAL_PORT = 55121
MAL_INST_HOST = 192.168.56.102
MAL_INST_PORT = 5246
MAL_DW_PORT = 65121
MAL_INST_DW_PORT = 45121
dmarch.ini
[ARCHIVE_REALTIME]
ARCH_TYPE = REALTIME
ARCH_DEST = GRP1_DM_02
[ARCHIVE_LOCAL1]
ARCH_TYPE = LOCAL
ARCH_DEST = /dm8/arch
ARCH_FILE_SIZE = 128
ARCH_SPACE_LIMIT =
dmwatcher.ini
[GRP1]
DW_TYPE = GLOBAL
DW_MODE = AUTO
DW_ERROR_TIME = 10
INST_RECOVER_TIME = 60
INST_ERROR_TIME = 10
INST_OGUID = 453331
INST_INI = /dm8/data/DMDW/dm.ini
INST_AUTO_RESTART = 1
INST_STARTUP_CMD = /dm8/bin/dmserver
RLOG_SEND_THRESHOLD = 0
RLOG_APPLY_THRESHOLD = 0
启动主库
./dmserver /dm8/data/DMDW/dm.ini mount
SQL>SP_SET_PARA_VALUE(1, 'ALTER_MODE_STATUS', 1);
SQL>sp_set_oguid(453331);
SQL>alter database primary;
SQL>SP_SET_PARA_VALUE(1, 'ALTER_MODE_STATUS', 0);
6.2设置备库配置文件
登陆备库主机192.168.56.102进行以下配置:
dm.ini
INSTANCE_NAME = GRP1_DM_02
PORT_NUM = 5246
DW_INACTIVE_INTERVAL = 60
ALTER_MODE_STATUS = 0
ENABLE_OFFLINE_TS = 2
MAL_INI = 1
ARCH_INI = 1RLOG_SEND_APPLY_MON = 64
MAL_CHECK_INTERVAL = 5
MAL_CONN_FAIL_INTERVAL = 5
[MAL_INST1]
MAL_INST_NAME = GRP1_DM_01
MAL_HOST = 192.168.56.101
MAL_PORT = 55101
MAL_INST_HOST = 192.168.56.101
MAL_INST_PORT = 5246
MAL_DW_PORT = 65101
MAL_INST_DW_PORT = 45101
[MAL_INST2]
MAL_INST_NAME = GRP1_DM_02
MAL_HOST = 192.168.56.102
MAL_PORT = 55121
MAL_INST_HOST = 192.168.56.102
MAL_INST_PORT = 5246
MAL_DW_PORT = 65121
MAL_INST_DW_PORT = 45121
dmarch.ini
[ARCHIVE_REALTIME]
ARCH_TYPE = REALTIME
ARCH_DEST = GRP1_DM_01
[ARCHIVE_LOCAL1]
ARCH_TYPE = LOCAL
ARCH_DEST = /dm8/arch
ARCH_FILE_SIZE = 128
ARCH_SPACE_LIMIT = 0
dmwatcher.ini
[GRP1]
DW_TYPE = GLOBAL
DW_MODE = AUTO
DW_ERROR_TIME = 10
INST_RECOVER_TIME = 60
INST_ERROR_TIME = 10
INST_OGUID = 453331
INST_INI = /dm8/data/DMDW/dm.ini
INST_AUTO_RESTART = 1
INST_STARTUP_CMD = /dm8/bin/dmserver
RLOG_APPLY_THRESHOLD = 0
以 Mount 方式启动备库
./dmserver /dm8/data/DMDW/dm.ini mount
SQL>SP_SET_PARA_VALUE(1, 'ALTER_MODE_STATUS', 1);
SQL>sp_set_oguid(453331);
SQL>alter database standby;
SQL>SP_SET_PARA_VALUE(1, 'ALTER_MODE_STATUS', 0);
6.3配置监视器
登陆监视器主机192.168.56.103进行以下配置:
dmmonitor.ini
MON_DW_CONFIRM = 1
MON_LOG_PATH = /dm8/data/log
MON_LOG_INTERVAL = 60
MON_LOG_FILE_SIZE = 32
MON_LOG_SPACE_LIMIT = 0
[GRP1]
MON_INST_OGUID = 453331
MON_DW_IP = 192.168.56.101:65101
MON_DW_IP = 192.168.56.102:65121
6.4启动守护进程
启动各个主备库上的守护进程:
./dmwatcher /dm8/data/DMDW/dmwatcher.ini
6.5启动监视器
登陆监视器主机,启动监视器服务:
./dmmonitor /dm8/dmmonitor.ini
到此,整个守护集群搭建完成。
三、问题总结
以上是在虚拟机环境安装部署达梦守护集群的操作步骤,中间过程出现的问题汇总如下:
1、达梦安装软件镜像挂载后,切换到dmdba用户,提示没有权限。
原因:没有给dmdba用户设置密码。
解决:执行以下步骤:
[root@dameng01 ~]# passwd dmdba
更改用户 dmdba 的密码 。
新的 密码:
重新输入新的 密码:
passwd:所有的身份验证令牌已经成功更新。
2、安装达梦软件报如下错误,原因:麒麟系统初始化安装的/tmp空间自动分配1.5G,需要扩大到2G才够用。
[dmdba@dameng02 mnt]$ ./DMInstall.bin
解压安装程序.........
OpenJDK 64-Bit Server VM warning: Insufficient space for shared memory file:
5412
Try using the -Djava.io.tmpdir= option to select an alternate temp location.Exception in thread "main" java.lang.UnsatisfiedLinkError: Could not load SWT library. Reasons:
no swt-gtk-3659 in java.library.path
no swt-gtk in java.library.path
Can't load library: /tmp/swtlib-64/libswt-gtk-3659.so
Can't load library: /tmp/swtlib-64/libswt-gtk.so
解决:使用root用户运行命令,mount -o remount,size=2G /tmp.