Linux环境
- 部署环境
软硬件配置情况 | |
IP | 192.168.124.129/192.168.124.130 |
操作系统 | Linux 3.10.0-957.el7.x86_64 |
CPU | 8核心 |
存储 | 本地磁盘30GB |
内存 | 5G |
数据库版本 | dm8_20230713_x86_rh6_64 |
注意事项 | 内存至少要5G,之前尝试在3G内存的虚拟机中部署,通过top-c发现安装过程中,换页操作的CPU占用率高达100%。原因是是内存过小的情况下,mem-available空间不够大,造成频繁换页。 |
- 部署规划
读写分离集群适合读多写少的应用环境。
1写2读3节点读写分离集群部署规划
IP规划:
主机名 | 服务ip | 心跳ip | 数据库名 | 实例名 |
dmdb01 | 192.168.124.129 | 192.168.124.129 | dmdb | rw1 |
dmdb02 | 192.168.124.130 | 192.168.124.130 | dmdb | rw2 |
端口规划:
实例名 | 实例端口 | MAL 系统监听 TCP 连接的端口 | 实例本地的守护进程监听 TCP 连接的端口 | 实例监听守护进程 TCP 连接的端口 |
rw1 | 5236 | 7336 | 7436 | 7536 |
rw2 | 5236 | 7336 | 7436 | 7536 |
目录规划:(在对应服务器上创建目录owner为dmdba组为dinstall)
数据库软件安装目录 | /home/dmdba/dmdbms |
实例安装目录 | /dmdata |
归档日志存放目录 | /dmarch |
备份文件存放目录 | /dmbak |
- 部署过程
3.1操作系统用户配置
达梦数据库在X86默认的用户权限下,其中一些参数不能适配安装。因为要修改例如最大打开文件数等参数进行适配。
3.1.1修改/etc/sysctl.conf
vim /etc/sysctl.conf
# sysctl settings are defined through files in
# /usr/lib/sysctl.d/, /run/sysctl.d/, and /etc/sysctl.d/.
#
# Vendors settings live in /usr/lib/sysctl.d/.
# To override a whole file, create a new file with the same in
# /etc/sysctl.d/ and put new settings there. To override
# only specific settings, add a file with a lexically later
# name in /etc/sysctl.d/ and put new settings there.
#
# For more information, see sysctl.conf(5) and sysctl.d(5).
fs.file-max = 6815744
fs.aio-max-nr = 1048576
kernel.shmmni = 4096
kernel.sem = 250 32000 100 128
net.ipv4.ip_local_port_range = 9000 65500
net.core.rmem_default = 4194304
net.core.rmem_max = 4194304
net.core.wmem_default = 262144
net.core.wmem_max = 1048576
vm.dirty_ratio = 80
vm.dirty_expire_centisecs = 500
vm.dirty_writeback_centisecs = 100
kernel.core_pattern = /dmdata/core.%p
vm.swappiness=10
vm.dirty_background_ratio = 0
vm.min_free_kbytes = 2097152
3.1.2配置生效
sysctl -p
3.1.3修改/etc/security/limit.conf
# Default limit for number of user's processes to prevent
# accidental fork bombs.
# See rhbz #432903 for reasoning.
* soft nproc 4096
root soft nproc unlimited
dmdba soft as unlimited
dmdba hard as unlimited
dmdba soft fsize unlimited
dmdba hard fsize unlimited
dmdba soft nproc 65536
dmdba hard nproc 65536
dmdba soft nofile 65536
dmdba hard nofile 65536
dmdba soft core unlimited
dmdba hard core unlimited
dmdba soft data unlimited
dmdba hard data unlimited
dmdba soft stack 65536
dmdba hard stack 65536
3.1.4新建用户组dinstall以及用户dmdba
# groupadd dinstall -g 2001
# useradd -G dinstall -m -d /home/dmdba -s /bin/bash -u 2001 dmdba
# passwd dmdba
dzy020131
mkdir -p /dmdata
chown -R dmdba:dinstall /dmdata
chown -R dmdba:dinstall /dmbak
chown -R dmdba:dinstall /dmarch
chown -R dmdba:dinstall /home/dmdba/
3.1.5配置环境变量
vim /home/dmdba/.bash_profile
export DM_HOME=/home/dmdba/dmdbms
export PATH=$PATH:$DM_HOME/bin
export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:$DM_HOME/bin
3.2 ISO文件挂载
3.2.1使用root用户挂载iso镜像到/dmiso
mkdir -p /dmiso
mount -o loop dm8_20230713_x86_rh6_64.iso /dmiso
3.2.2切换到dmdba用户安装数据库
su dmdba
/dmiso/DMInstall.sh -i
[dmdba@master dmiso]$ ./DMInstall.bin -i
请选择安装语言(C/c:中文 E/e:英文) [C/c]:c
解压安装程序..........
欢迎使用达梦数据库安装程序
是否输入Key文件路径? (Y/y:是 N/n:否) [Y/y]:y
请输入Key文件的路径地址 [dm.key]:/home/dmdba/dm.key
有效日期: 2023-12-25
服务器颁布类型: 安全版
发布类型: 试用版
用户名称: 达梦公司产品试用
授权用户数: 无限制
并发连接数: 无限制
是否设置时区? (Y/y:是 N/n:否) [Y/y]:y
设置时区:
[ 1]: GTM-12=日界线西
[ 2]: GTM-11=萨摩亚群岛
[ 3]: GTM-10=夏威夷
[ 4]: GTM-09=阿拉斯加
[ 5]: GTM-08=太平洋时间(美国和加拿大)
[ 6]: GTM-07=亚利桑那
[ 7]: GTM-06=中部时间(美国和加拿大)
[ 8]: GTM-05=东部部时间(美-国和加拿大)
[ 9]: GTM-04=大西洋时间(美国和加拿大)
[10]: GTM-03=巴西利亚
[11]: GTM-02=中大西洋
[12]: GTM-01=亚速尔群岛
[13]: GTM=格林威治标准时间
[14]: GTM+01=萨拉热窝
[15]: GTM+02=开罗
[16]: GTM+03=莫斯科
[17]: GTM+04=阿布扎比
[18]: GTM+05=伊斯兰堡
[19]: GTM+06=达卡
[20]: GTM+07=曼谷,河内
[21]: GTM+08=中国标准时间
[22]: GTM+09=汉城
[23]: GTM+10=关岛
[24]: GTM+11=所罗门群岛
[25]: GTM+12=斐济
[26]: GTM+13=努库阿勒法
[27]: GTM+14=基里巴斯
请选择设置时区 [21]:21
安装类型:
1 典型安装
2 服务器
3 客户端
4 自定义
请选择安装类型的数字序号 [1 典型安装]:1
所需空间: 1869M
请选择安装目录 [/home/dmdba/dmdbms]:/home/dmdba/dmdbms
可用空间: 50G
是否确认安装路径(/home/dmdba/dmdbms)? (Y/y:是 N/n:否) [Y/y]:y
安装前小结
安装位置: /home/dmdba/dmdbms
所需空间: 1869M
可用空间: 50G
版本信息: 安全版
有效日期: 2023-12-25
安装类型: 典型安装
是否确认安装? (Y/y:是 N/n:否):y
2023-10-31 11:07:49
[INFO] 安装 基础 模块...
2023-10-31 11:07:49
[INFO] 安装达梦数据库...
2023-10-31 11:08:23
[INFO] 安装 服务器 模块...
2023-10-31 11:08:31
[INFO] 安装 客户端 模块...
2023-10-31 11:09:11
[INFO] 安装 驱动 模块...
2023-10-31 11:09:29
[INFO] 安装 手册 模块...
2023-10-31 11:09:33
[INFO] 安装 服务 模块...
2023-10-31 11:09:33
[INFO] 移动日志文件。
2023-10-31 11:09:34
[INFO] 安装达梦数据库完成。
请以root系统用户执行命令:
/home/dmdba/dmdbms/script/root/root_installer.sh
安装结束
3.2.3切换权限至root用户权限运行脚本
/home/dmdba/dmdbms/script/root/root_installer.sh
3.3 初始化实例
两个节点均初始化
cd /home/dmdba/dmdbms/bin
./dminit path=/dmdata page_size=32 extent_size=32 charset=1 log_size=2048 db_name=dmdb instance_name=dmdb SYSDBA_PWD="dzy020131" SYSAUDITOR_PWD="dzy020131"
以主机为分离主库,启动实例
dmserver /dmdata/dmdb/dm.ini
出现SYSTEM IS READY后EXIT退出
version info: security
DM Database Server 64 V8 05134284058-20230713-195546-20046 startup...
Normal of FAST
Normal of DEFAULT
Normal of RECYCLE
Normal of KEEP
Normal of ROLL
Database mode = 0, oguid = 0
License will expire on 2023-12-25
file lsn: 0
ndct db load finished, code:0
ndct second level fill fast pool finished
ndct third level fill fast pool finished
ndct second level fill fast pool finished
ndct third level fill fast pool finished
ndct fill fast pool finished
pseg_set_gtv_trxid_low next_trxid in mem:[2002]
pseg_collect_mgr_items, total collect 0 active_trxs, 0 cmt_trxs, 0 pre_cmt_trxs, 0 to_release_trxs, 0 active_pages, 0 cmt_pages, 0 pre_cmt_pages, 0 to_release_pages, 0 mgr pages, 0 mgr recs!
next_trxid in mem:[4004]
next_trxid = 6006.
pseg recv finished
nsvr_startup end.
uthr_pipe_create, create pipe[read:12, write:13]
uthr_pipe_create, create pipe[read:14, write:15]
uthr_pipe_create, create pipe[read:16, write:17]
uthr_pipe_create, create pipe[read:18, write:19]
uthr_pipe_create, create pipe[read:20, write:21]
uthr_pipe_create, create pipe[read:22, write:23]
uthr_pipe_create, create pipe[read:24, write:25]
uthr_pipe_create, create pipe[read:26, write:27]
uthr_pipe_create, create pipe[read:28, write:29]
uthr_pipe_create, create pipe[read:30, write:31]
uthr_pipe_create, create pipe[read:32, write:33]
uthr_pipe_create, create pipe[read:34, write:35]
uthr_pipe_create, create pipe[read:36, write:37]
uthr_pipe_create, create pipe[read:38, write:39]
uthr_pipe_create, create pipe[read:40, write:41]
uthr_pipe_create, create pipe[read:42, write:43]
aud sys init success.
aud rt sys init success.
trx: 6006 purged 1 pages
trx: 6025 purged 1 pages
trx: 6026 purged 1 pages
trx: 6027 purged 1 pages
trx: 6028 purged 1 pages
trx: 6029 purged 1 pages
trx: 6039 purged 1 pages
trx: 6162 purged 1 pages
trx: 6175 purged 1 pages
trx: 6176 purged 1 pages
trx: 6177 purged 1 pages
trx: 6178 purged 1 pages
trx: 6179 purged 1 pages
trx: 6181 purged 1 pages
trx: 6182 purged 1 pages
trx: 6184 purged 1 pages
trx: 6186 purged 1 pages
trx: 6193 purged 1 pages
trx: 6199 purged 1 pages
trx: 6209 purged 1 pages
trx: 6222 purged 1 pages
trx: 6223 purged 1 pages
trx: 6224 purged 1 pages
trx: 6225 purged 1 pages
trx: 6237 purged 1 pages
trx: 6239 purged 1 pages
trx: 6240 purged 1 pages
trx: 6241 purged 1 pages
trx: 6293 purged 1 pages
trx: 6294 purged 1 pages
trx: 6305 purged 1 pages
trx: 6319 purged 8 pages
trx: 6346 purged 1 pages
trx: 6347 purged 1 pages
trx: 6348 purged 1 pages
trx: 6349 purged 1 pages
trx: 6355 purged 1 pages
trx: 6357 purged 1 pages
trx: 6359 purged 1 pages
trx: 6364 purged 1 pages
trx: 6369 purged 1 pages
trx: 6374 purged 1 pages
trx: 6376 purged 1 pages
trx: 6379 purged 1 pages
trx: 6381 purged 1 pages
trx: 6387 purged 1 pages
trx: 6388 purged 1 pages
trx: 6537 purged 1 pages
trx: 6549 purged 1 pages
trx: 6554 purged 1 pages
trx: 6559 purged 1 pages
trx: 6578 purged 11 pages
trx: 6579 purged 1 pages
trx: 6586 purged 1 pages
trx: 6591 purged 1 pages
trx: 6596 purged 1 pages
trx: 6630 purged 1 pages
trx: 6634 purged 1 pages
trx: 6636 purged 1 pages
trx: 6638 purged 1 pages
trx: 6640 purged 1 pages
trx: 6642 purged 1 pages
trx: 6644 purged 1 pages
trx: 6646 purged 1 pages
trx: 6648 purged 1 pages
trx: 6650 purged 1 pages
trx: 6652 purged 1 pages
trx: 6654 purged 1 pages
trx: 6656 purged 1 pages
trx: 6658 purged 1 pages
trx: 6660 purged 1 pages
trx: 6662 purged 1 pages
trx: 6664 purged 1 pages
trx: 6666 purged 1 pages
trx: 6668 purged 1 pages
trx: 6670 purged 1 pages
trx: 6672 purged 1 pages
trx: 6674 purged 1 pages
trx: 6676 purged 1 pages
trx: 6678 purged 1 pages
trx: 6680 purged 1 pages
trx: 6683 purged 2 pages
systables desc init success.
ndct_db_load_info finished, code:0.
nsvr_process_before_open begin.
nsvr_process_before_open success.
SYSTEM IS READY.
exit
Server is stopping...
listener closed and all sessions disconnected
adjust undo_retention & wakeup purge thread...full check point starting...
generate force checkpoint, rlog free space[4277669888], used space[17289216]
checkpoint begin, used_space[17289216], free_space[4277669888]...
checkpoint end, 0 pages flushed, used_space[0], free_space[4294959104].
full check point end.
shutdown audit subsystem...OK
shutdown schedule subsystem...OK
shutdown timer successfully.
pre-shutdown MAL subsystem...OK
shutdown worker threads subsystem...OK
shutdown logic log subsystem...OK
shutdown sequence cache subsystem...OK
wait for mtsk link worker to exit..OK
shutdown mpp session subsystem...OK
wait for rapply is all over... OK
rapply worker threads exit successfully.
pre ending task & worker threads...OK
shutdown dblink subsystem...OK
shutdown local parallel threads pool successfully.
shutdown pthd_pools...OK
shutdown session subsystem...shutdown aux session subsystem...OK
shutdown rollback segments purging subsystem...OK
shutdown transaction subsystem...OK
shutdown locking subsystem...OK
shutdown dbms_lock subsystem...OK
ending tsk and worker threads...OK
ckpt2_exec_immediately begin.
checkpoint begin, used_space[0], free_space[4294959104]...
checkpoint end, 0 pages flushed, used_space[8192], free_space[4294950912].
checkpoint begin, used_space[8192], free_space[4294950912]...
checkpoint end, 0 pages flushed, used_space[0], free_space[4294959104].
checkpoint begin, used_space[0], free_space[4294959104]...
checkpoint end, 0 pages flushed, used_space[0], free_space[4294959104].
shutdown archive subsystem...OK
shutdown redo log subsystem...OK
shutdown MAL subsystem...OK
shutdown message compress subsystem successfully.
shutdown task subsystem...OK
shutdown trace subsystem...OK
shutdown svr_log subsystem...OK
shutdown plan cache subsystem...OK
shutdown database dictionary subsystem...OK
shutdown file subsystem...OK
shutdown mac cache subsystem...OK
shutdown dynamic login cache subsystem...OK
shutdown ifun/bifun/sfun/afun cache subsystem...OK
shutdown crypt subsystem...OK
shutdown pipe subsystem...OK
shutdown compress component...OK
shutdown slave redo subsystem...OK
shutdown kernel buffer subsystem...OK
shutdown SQL capture subsystem...OK
shutdown control file system...OK
shutdown dtype subsystem...OK
shutdown huge buffer and memory pools...OK
close lsnr socket
DM Database Server shutdown successfully.
3.4 脱机备份主库
在主机确认dmap服务已开启
ps -ef|grep dmap
若未启动,手动启动方式为:
/home/dmdba/dmdbms/bin/DmAPService start
dmdba用户启动dmrman服务
dmrman use_ap=2
执行全库备份
backup database '/dmdata/dmdb/dm.ini' backupset '/home/dmdba/bakfull';
3.5 备份还原备库
使用ROOT用户,将节点1的备份上传到节点2服务器上,通过DMRMAN工具实现还原。
dmrman use_ap=2
restore database '/dmdata/dmdb/dm.ini' from backupset '/home/dmdba/bakfull';
recover database '/dmdata/dmdb/dm.ini' from backupset '/home/dmdba/bakfull';
recover database '/dmdata/dmdb/dm.ini' update db_magic;
[root@slave bin]# dmrman use_ap=2
dmrman V8
RMAN> restore database '/dmdata/dmdb/dm.ini' from backupset '/home/dmdba/bakfull';
restore database '/dmdata/dmdb/dm.ini' from backupset '/home/dmdba/bakfull';
Normal of FAST
Normal of DEFAULT
Normal of RECYCLE
Normal of KEEP
Normal of ROLL
[Percent:100.00%][Speed:0.00M/s][Cost:00:00:05][Remaining:00:00:00]
restore successfully.
time used: 00:00:05.731
RMAN> recover database '/dmdata/dmdb/dm.ini' from backupset '/home/dmdba/bakfull';
recover database '/dmdata/dmdb/dm.ini' from backupset '/home/dmdba/bakfull';
Database mode = 2, oguid = 0
Normal of FAST
Normal of DEFAULT
Normal of RECYCLE
Normal of KEEP
Normal of ROLL
EP[0]'s cur_lsn[40471], file_lsn[40471]
recover successfully!
time used: 936.498(ms)
RMAN> recover database '/dmdata/dmdb/dm.ini' update db_magic;
recover database '/dmdata/dmdb/dm.ini' update db_magic;
Database mode = 2, oguid = 0
Normal of FAST
Normal of DEFAULT
Normal of RECYCLE
Normal of KEEP
Normal of ROLL
EP[0]'s cur_lsn[40471], file_lsn[40471]
recover successfully!
time used: 00:00:01.075
3.6 修改dm.ini参数
节点1要修改的参数
INSTANCE_NAME = rw1
MAL_INI = 1
ARCH_INI = 1
ALTER_MODE_STATUS = 0
ENABLE_OFFLINE_TS = 2
节点2要修改的参数
INSTANCE_NAME = rw2
MAL_INI = 1
ARCH_INI = 1
ALTER_MODE_STATUS = 0
ENABLE_OFFLINE_TS = 2
3.7 配置归档配置文件dmarch.ini
节点1的dmarch.ini
ARCH_WAIT_APPLY=1
[ARCHIVE_REALTIME1]
ARCH_TYPE = REALTIME
ARCH_DEST = rw2
[ARCHIVE_LOCAL1]
ARCH_TYPE = LOCAL
ARCH_DEST = /dmarch
ARCH_FILE_SIZE = 2048
ARCH_SPACE_LIMIT = 102400
节点2的dmarch.ini
ARCH_WAIT_APPLY=1
[ARCHIVE_REALTIME1]
ARCH_TYPE = REALTIME #实时归档类型
ARCH_DEST = rw1 #实时归档目标实例名(备库侧填写主库实例名)
[ARCHIVE_LOCAL1]
ARCH_TYPE = LOCAL
ARCH_DEST = /dmarch #本地归档文件存放路径
ARCH_FILE_SIZE = 2048 #单位 MB,本地单个归档文件最大值
ARCH_SPACE_LIMIT = 102400 #单位 MB,0 表示无限制,范围 1024~4294967294 MB
3.8 配置MAL系统配置文件dmmal.ini
主备库2个节点文件内容要相同。 注释信息在正式配置文件中要删除
MAL_CHECK_INTERVAL = 5
MAL_CONN_FAIL_INTERVAL = 15
[MAL_INST1]
MAL_INST_NAME = rw1
MAL_HOST = 192.168.124.129
MAL_PORT = 7336
MAL_INST_HOST = 192.168.124.129
MAL_INST_PORT = 5236
MAL_DW_PORT = 7436
MAL_INST_DW_PORT = 7536
[MAL_INST2]
MAL_INST_NAME = rw2 #与 dm.ini 中的 INSTANCE_NAME 一致
MAL_HOST = 192.168.124.130 # MAL 系统监听 TCP 内部网络 IP
MAL_PORT = 61141 #MAL 系统监听 TCP 连接的端口
MAL_INST_HOST = 192.168.124.130#实例的对外服务 IP 地址
MAL_INST_PORT = 5236 #与 dm.ini 中的 PORT_NUM 一致
MAL_DW_PORT = 52141 #实例对应的守护进程监听 TCP 端口
MAL_INST_DW_PORT = 33141
3.9 配置守护进程配置文件dmwatcher.ini
主备库2个节点文件内容要相同。 注释信息在正式配置文件中要删除
[GRP_RW]
DW_TYPE = GLOBAL #全局守护类型
DW_MODE = AUTO #自动切换模式
DW_ERROR_TIME = 30 #远程守护进程故障认定时间
INST_RECOVER_TIME = 60 #主库守护进程启动恢复的间隔时间
INST_ERROR_TIME = 20 #本地实例故障认定时间
INST_OGUID = 453331 #守护系统唯一 OGUID 值
INST_INI = /dmdata/dmdb/dm.ini #dm.ini 配置文件路径
INST_AUTO_RESTART = 1 #打开实例的自动启动功能
INST_STARTUP_CMD = /home/dmdba/dmdbms/bin/dmserver #命令行方式启动
使用 dmdba 用户,以 mount 方式启动数据库实例,执行以下命令(主备库都执行)
dmserver /dmdata/dmdb/dm.ini mount
用新的终端连接数据库
./disql SYSDBA/Hn@dameng123
主备库都修改 oguid
sp_set_oguid(453331);
节点1修改数据库模式为primary
alter database primary
节点2修改数据库模式为standby
alter database standby
启动守护进程
dmdba 用户下,到数据库安装目录的 bin 下执行以下命令(主备库都执行)
dmwatcher /dmdata/dmdb/dmwatcher.ini
守护进程启动后,会将 Mount 的实例 Open。
启动监视器
守护进程配置为自动切换时,必须配置确认监视器。在主备服务器以外的服务器上(需安装有 DM 数据库软件,且与主备心跳网络端口开放)。
新建确认监视器配置文件 dmmonitor.ini,执行以下命令
vim dmmonitor.ini
MON_DW_CONFIRM = 1 #确认监视器模式
MON_LOG_PATH = /home/dmdba/dmdbms/log #监视器日志文件存放路径
MON_LOG_INTERVAL = 60 #每隔 60 s 定时记录系统信息到日志文件
MON_LOG_FILE_SIZE = 200#每个日志文件最大 32 MB
MON_LOG_SPACE_LIMIT = 1024 #不限定日志文件总占用空间
[GRP_RW]
MON_INST_OGUID = 453331 #组 GRP_RW 的唯一 OGUID 值
#以下配置为监视器到组 GRP_RW 的守护进程的连接信息,以“IP:PORT”的形式配置
#IP 对应 dmmal.ini 中的 MAL_HOST,PORT 对应 dmmal.ini 中的 MAL_DW_PORT
MON_DW_IP = 192.168.124.129:52141
MON_DW_IP = 192.168.124.130:52141
vim dmmonitor.ini
MON_DW_CONFIRM = 1
MON_LOG_PATH = /home/dmdba/dmdbms/log
MON_LOG_INTERVAL = 60
MON_LOG_FILE_SIZE = 200
MON_LOG_SPACE_LIMIT = 1024
[GRP_RW]
MON_INST_OGUID = 453331
MON_DW_IP = 192.168.124.129:7436
MON_DW_IP = 192.168.124.130:52141
启动监视器
dmmonitor /dmdata/dmdb/dmmonitor.ini
show
3.10 注册服务
以上启动为前台方式启动,仅用户搭建过程中验证配置。配置没问题后需要将实例,守护进程和确认监视器注册为系统服务。
使用 root 用户,到数据库安装目录的script/root下。
注册守护进程服务(主备库都执行)。
./dm_service_installer.sh -t dmwatcher -p rw -watcher_ini /dmdata/dmdb/dmwatcher.ini
注册数据库实例服务(主备库都执行)
./dm_service_installer.sh -t dmserver -p rw -dm_ini /dmdata/dmdb/dm.ini
以服务方式启动 执行以下命令,启动数据库实例(主备库都执行)
systemctl start DmServicerw
systemctl start DmWatcherServicerw
注册监视器服务,在SCRIPT/ROOT目录下
./dm_service_installer.sh -t dmmonitor -p confirm -monitor_ini /dmdata/dmdb/dmmonitor.ini
启动监视器实例
systemctl start DmMonitorServiceconfirm
3.11 验证主备集群同步状态
打开监控器
./dmmonitor /dmdata/dmdb/dmmonitor.ini
输入 show 命令查看集群状态:
Show
登录主库创建测试库,测试功能
create table test(id int);
insert into test values (1);
commit;
3.12 配置sql日志
所有节点修改sqllog.ini
BUF_TOTAL_SIZE = 10240
BUF_SIZE = 1024
BUF_KEEP_CNT = 6
[SLOG_ALL]
FILE_PATH = ../log
PART_STOR = 1
SWITCH_MODE = 2
SWITCH_LIMIT = 512
ASYNC_FLUSH = 1
FILE_NUM = 5
ITEMS = 0
SQL_TRACE_MASK = 2:3:25
MIN_EXEC_TIME = 1500
USER_MODE = 0
USERS =
3.13 参数优化
AutoParaAdj3.7_dm8.sql
之后需要重启集群,顺序严格按照如下进行
关闭确认监视器:systemctl stop DmMonitorServiceconfirm
关闭备库守护进程:systemctl stop DmWatcherServicerw
关闭主库守护进程:systemctl stop DmWatcherServicerw
关闭主库实例:systemctl stop DmServicerw
关闭备库实例:systemctl stop DmServicerw
启动备库实例:systemctl start DmServicerw
启动主库实例:systemctl start DmServicerw
启动主库守护进程:systemctl start DmWatcherServicerw
启动备库守护进程:systemctl start DmWatcherServicerw
启动确认监视器:systemctl start DmMonitorServiceconfirm
3.14 备份策略
周六全量备份、周日到周五增量备份,每天删除30天前的备份集。
sp_init_job_sys(1);
//作业系统重启会清空作业。
3.14.1全量备份(每周六 23 点)
call SP_CREATE_JOB('bakfull',1,0,'',0,0,'',0,'');
call SP_JOB_CONFIG_START('bakfull');
call SP_ADD_JOB_STEP('bakfull', 'bak1', 6, '01020000/dmbak', 0, 0, 0, 0, NULL, 0);
call SP_ADD_JOB_SCHEDULE('bakfull', 'std1', 1, 2, 1, 64, 0, '23:00:00', NULL, sysdate, NULL, '');
call SP_JOB_CONFIG_COMMIT('bakfull');
3.14.2 增量备份(除周六外每天 23 点)
call SP_CREATE_JOB('bakincr',1,0,'',0,0,'',0,'');
call SP_JOB_CONFIG_START('bakincr');call SP_ADD_JOB_STEP('bakincr', 'bak2', 6, '41010000/dmbak/|/dmbak/', 0, 0, 0, 0, NULL, 0);
call SP_ADD_JOB_SCHEDULE('bakincr', 'std2', 1, 2, 1, 63, 0, '23:00:00', NULL,sysdate, NULL, '');
call SP_JOB_CONFIG_COMMIT('bakincr');
3.14.3删除备份(每天 23 点 30删除14天前的备份)
call SP_CREATE_JOB('delbak',1,0,'',0,0,'',0,'');
call SP_JOB_CONFIG_START('delbak');
call SP_ADD_JOB_STEP('delbak','bak1',0, 'SF_BAKSET_BACKUP_DIR_ADD(''DISK'',''/dmbak/'');call
sp_db_bakset_remove_batch(''DISK'',now()-30);', 1, 2, 0, 0, NULL, 0);
call SP_ADD_JOB_SCHEDULE('delbak', 'del01', 1, 1, 1, 0, 0, '23:30:00', NULL,sysdate, NULL, '');
call SP_JOB_CONFIG_COMMIT('delbak');
测试备份作业执行:
先查询对应作业的 ID
select * from sysjob.sysjobs;
手动执行作业()内填写作业 ID
call SP_DBMS_JOB_RUN(1698743207);
执行完后再对应路径下查看是否有全备的作业,注意:没有一份全备文件前,增量备份作业
无法执行成功。
作业设置的详细说明可查看《作业系统使用手册》。
添加自动收集统计信息的任务(每天 1 点收集全库统计信息)
call SP_CREATE_JOB('statistics',1,0,'',0,0,'',0,'');
call SP_JOB_CONFIG_START('statistics');
call SP_ADD_JOB_STEP('statistics', 'statistics1', 0, 'begin
for rs in (select ''sf_set_SESSION_para_value(''''HAGR_HASH_SIZE'''',(select cast(
case when max(table_rowcount(owner,table_name))<=(select max_value from v$dm_ini
where para_Name=''''HAGR_HASH_SIZE'''') and max(table_rowcount(owner,table_name))>=(
select min_value from v$dm_ini where para_Name=''''HAGR_HASH_SIZE'''') then
max(table_rowcount(owner,table_name)) when max(table_rowcount(owner,table_name))<(
select min_value from v$dm_ini where para_Name=''''HAGR_HASH_SIZE'''') then
(select min_value from v$dm_ini where para_Name=''''HAGR_HASH_SIZE'''') else
(select max_value from v$dm_ini where para_Name=''''HAGR_HASH_SIZE'''') end as bigint)
from dba_tables where owner=''''''||NAME||''''''));''
sql1,''DBMS_STATS.GATHER_SCHEMA_STATS(''''''||NAME||'''''',100,TRUE,''''FOR ALL COLUMNS
SIZE AUTO'''');''
sql2
from SYS.SYSOBJECTS where TYPE$=''SCH'' ) loop
execute immediate rs.sql1;
execute immediate rs.sql2;
end loop;
end;', 0, 0, 0, 0, NULL, 0);
call SP_ADD_JOB_SCHEDULE('statistics', 'statistics1', 1, 2, 1, 64, 0, '01:00:00', NULL, '2021-06-09
22:54:37', NULL, '');
call SP_JOB_CONFIG_COMMIT('statistics');
说明:每周 6 凌晨 1 点开始收集。
3.15 客户端连接集群
客户端主机上需要配置 dm_svc.conf 文件(未安装 DM 数据库的机器新建即可),文件路径:
32 位的 DM 安装在 Win32 操作平台下,此文件位于 %SystemRoot%\system32 目录;
64 位的 DM 安装在 Win64 操作平台下,此文件位于 %SystemRoot%\system32 目录;
32 位的 DM 安装在 Win64 操作平台下,此文件位于 %SystemRoot%\SysWOW64 目录;
在 Linux 平台下,此文件位于/etc 目录。
文件内容
# 以#开头的行表示是注释
# 全局配置区
DMRW=(192.168.124.129:5236,192.168.124.130:5236)
TIME_ZONE=(+480) #表示+8:00 时区
LOGIN_ENCRYPT=(0)
DIRECT=(Y)
# 服务配置区
[DMRW]
LOGIN_MODE=(1)#只连主库
RW_SEPARATE=(1) #是否启用读写分离
RW_PERCENT=(10) #读写分离分发比例
客户端程序连接数据库时,需要指定 IP 端口处替换为服务名即可,例如:
disql SYSDBA/'"Hn@dameng123"'@DMRW
jdbc的url为:jdbc:dm://DMRW
注意:
1)当修改了 dm_svc.conf 内容后,需要重启客户端程序,修改的配置才能生效。
2)请把该文件路径授予666权限。
社区地址:https://eco.dameng.com