搭建达梦DSC集群
架构介绍
DMDSC 集群是一个多实例、单数据库的系统。 多个数据库实例可以同时访问、修改同一个数据库的数据。 用户可以登录集群中的任意一个数据库实例，获得完整的数据库服务。数据文件、控制文件在集群系统中只有一份，不论有几个节点，这些节点都平等地使用这些文件。各个节点有自己独立的联机日志和归档日志。 这些文件就保存在共享存储上
1.系统配置（centos7）
1.1.划盘
磁盘规划
| 磁盘组名称 | 作用 | 大小 |
|---|---|---|
| DCR | 存放集群配置信息 | 100M |
| VOTE | 仲裁盘信息 | 100M |
| DATA | 存储数据文件 | 40G |
| LOG | 存放日志文件 | 5G |
[root@dameng1 soft]# fdisk -l | grep sd
Disk /dev/sda: 107.4 GB, 107374182400 bytes, 209715200 sectors
/dev/sda1 * 2048 616447 307200 83 Linux
/dev/sda2 616448 4812799 2098176 82 Linux swap / Solaris
/dev/sda3 4812800 209715199 102451200 83 Linux
Disk /dev/sdb: 42.9 GB, 42949672960 bytes, 83886080 sectors.
1)输入 fdisk /dev/sdb
2) 依次输入 n > p > 1 > 回车> +100M > 回车，完成第一块磁盘划分
3) 依次输入 n > p > 2 > 回车> +100M > 回车，完成第二块磁盘划分
4) 依次输入 n > p > 3 > 回车> +40G > 回车，完成第三块磁盘划分
5) 依次输入 n > p > 4 > 回车> 回车> 回车，完成第四块磁盘划分
[root@dameng1 soft]# fdisk -l | grep sd
Disk /dev/sda: 107.4 GB, 107374182400 bytes, 209715200 sectors
/dev/sda1 * 2048 616447 307200 83 Linux
/dev/sda2 616448 4812799 2098176 82 Linux swap / Solaris
/dev/sda3 4812800 209715199 102451200 83 Linux
Disk /dev/sdb: 42.9 GB, 42949672960 bytes, 83886080 sectors
/dev/sdb1 2048 206847 102400 83 Linux
/dev/sdb2 206848 411647 102400 83 Linux
/dev/sdb3 411648 4605951 2097152 83 Linux
/dev/sdb4 4605952 83886079 39640064 83 Linux
- 编辑vi /etc/udev/rules.d/60-raw.rules 文件，增加以下语句：
ACTION=="add", KERNEL=="sdb1", RUN+="/bin/raw /dev/raw/raw1 %N"
ACTION=="add", KERNEL=="sdb2", RUN+="/bin/raw /dev/raw/raw2 %N"
ACTION=="add", KERNEL=="sdb3", RUN+="/bin/raw /dev/raw/raw3 %N"
ACTION=="add", KERNEL=="sdb4", RUN+="/bin/raw /dev/raw/raw4 %N"
ACTION=="add", KERNEL=="raw[1-4]", OWNER="dmdba", GROUP="dinstall", MODE="660"
注意：官方给的盘权限为root:root , 安装是没有问题的，但是后面使用过程中启动会报权限不足，需要修改为dmdba。
重启加载udev或者
/sbin/udevadm trigger --type=devices --action=change /sbin/udevadm control --reload
1.2.创建dcr配置文件dmdcr_cfg.ini
vi /dm/data/dmdcr_cfg.ini
DCR_N_GRP = 3
DCR_VTD_PATH = /dev/raw/raw2
DCR_OGUID = 63635
[GRP]
DCR_GRP_TYPE = CSS
DCR_GRP_NAME = GRP_CSS
DCR_GRP_N_EP = 2
DCR_GRP_DSKCHK_CNT = 60
[GRP_CSS]
DCR_EP_NAME = CSS0
DCR_EP_HOST = 192.168.71.131
DCR_EP_PORT = 9341
[GRP_CSS]
DCR_EP_NAME = CSS1
DCR_EP_HOST = 192.168.71.132
DCR_EP_PORT = 9343
[GRP]
DCR_GRP_TYPE = ASM
DCR_GRP_NAME = GRP_ASM
DCR_GRP_N_EP = 2
DCR_GRP_DSKCHK_CNT = 60
[GRP_ASM]
DCR_EP_NAME = ASM0
DCR_EP_SHM_KEY = 93360
DCR_EP_SHM_SIZE = 10
DCR_EP_HOST = 192.168.71.131
DCR_EP_PORT = 9349
DCR_EP_ASM_LOAD_PATH = /dev/raw
[GRP_ASM]
DCR_EP_NAME = ASM1
DCR_EP_SHM_KEY = 93361
DCR_EP_SHM_SIZE = 10
DCR_EP_HOST = 192.168.71.132
DCR_EP_PORT = 9351
DCR_EP_ASM_LOAD_PATH = /dev/raw
[GRP]
DCR_GRP_TYPE = DB
DCR_GRP_NAME = GRP_DSC
DCR_GRP_N_EP = 2
DCR_GRP_DSKCHK_CNT = 60
[GRP_DSC]
DCR_EP_NAME = DSC0
DCR_EP_SEQNO = 0
DCR_EP_PORT = 5236
DCR_CHECK_PORT = 9741
[GRP_DSC]
DCR_EP_NAME = DSC1
DCR_EP_SEQNO = 1
DCR_EP_PORT = 5236
DCR_CHECK_PORT = 9742
1.3.创建asm磁盘
[root@dameng1 ~]# export LD_LIBRARY_PATH="$LD_LIBRARY_PATH:/dm/dmdbms/bin"
[root@dameng1 ~]# /dm/dmdbms/bin/dmasmcmd
DMASMCMD V8
ASM>create dcrdisk '/dev/raw/raw1' 'dcr'
[Trace]The ASM initialize dcrdisk /dev/raw/raw1 to name DMASMdcr
Used time: 14.098(ms).
ASM>create votedisk '/dev/raw/raw2' 'vote'
[Trace]The ASM initialize votedisk /dev/raw/raw2 to name DMASMvote
Used time: 18.603(ms).
ASM>create asmdisk '/dev/raw/raw3' 'LOG0'
[Trace]The ASM initialize asmdisk /dev/raw/raw3 to name DMASMLOG0
Used time: 13.575(ms).
ASM>create asmdisk '/dev/raw/raw4' 'DATA0'
[Trace]The ASM initialize asmdisk /dev/raw/raw4 to name DMASMDATA0
Used time: 0.717(ms).
ASM>init dcrdisk '/dev/raw/raw1' from '/dm/data/dmdcr_cfg.ini'identified by 'dameng'
[Trace]DG 126 allocate 4 extents for file 0xfe000002.
Used time: 67.942(ms).
ASM>init votedisk '/dev/raw/raw2' from '/dm/data/dmdcr_cfg.ini'
[Trace]DG 125 allocate 4 extents for file 0xfd000002.
Used time: 43.126(ms).
ASM>
1.4.准备集群配置文件（两节点一样）
DMASM 的两个节点分别配置 dmdcr.ini， dmdcr_path 相同， dmasvrmal.ini 文件内容也相同， dmdcr_seqo 分别为 0 和 1。
1.4.1.MAL 配置文件
创建dmasvrmal.ini 文件
[root@dameng1 ~]# cd /dm/data/
[root@dameng1 data]# vi dmasvrmal.ini
DCR_EP_PORT = 5236
DCR_CHECK_PORT = 9741
[GRP_DSC]
[MAL_INST1]
MAL_INST_NAME = ASM0
MAL_HOST = 192.168.71.131
MAL_PORT = 7236
[MAL_INST2]
MAL_INST_NAME = ASM1
MAL_HOST = 192.168.71.132
MAL_PORT = 7237
1.4.2.dmdcr.ini 配置文件(2节点DMDCR_SEQNO改成1,路径的dsc0改成dsc1)
[root@dameng1 data]# vi dmdcr.ini
DMDCR_PATH = /dev/raw/raw1
DMDCR_MAL_PATH =/dm/data/dmasvrmal.ini
DMDCR_SEQNO = 0
#ASM 重启参数，命令行方式启动
DMDCR_ASM_RESTART_INTERVAL = 0
DMDCR_ASM_STARTUP_CMD = /dm/dmdbms/bin/dmasmsvr dcr_ini=/dm/data/dmdcr.ini
#DB 重启参数，命令行方式启动
DMDCR_DB_RESTART_INTERVAL = 0
DMDCR_DB_STARTUP_CMD = /dm/dmdbms/bin/dmserver path=/dm/data/dsc1_config/dm.ini dcr_ini=/dm/data/dmdcr.ini
1.5.手工启动 DMCSS、DMASM 服务程序
这里用root用户启动，最好用dmdba用户启动，否则后期用dmdba用户启动没有权限写日志文件。
在两个节点先后分别启动 dmcss、dmasmsvr 程序。
先按顺序手动启动 dmcss 命令：
[root@dameng1 bin]# ./dmcss DCR_INI=/dm/data/dmdcr.ini
再按顺序手动启动 dmasmsvr 命令：
[root@dameng1 bin]# ./dmasmsvr DCR_INI=/home/data/dmdcr.ini
1.6.创建ASM磁盘组
[root@dameng1 ~]# cd /dm/dmdbms/bin
[root@dameng1 bin]# ./dmasmtool DCR_INI=/dm/data/dmdcr.ini
DMASMTOOL V8
#创建日志磁盘组
ASM>create diskgroup 'DMLOG' asmdisk '/dev/raw/raw3'
Used time: 8.782(ms).
#创建数据磁盘组
ASM>create diskgroup 'DMDATA' asmdisk '/dev/raw/raw4'
Used time: 8.412(ms).
1.7.注册集群服务
1） 分别在2个节点注册DMCSS和DMASM服务
以root用户执行
节点DSC1:
#DMCSS:
[root@dameng1 bin]# /dm/dmdbms/script/root/dm_service_installer.sh -t dmcss -dcr_ini /dm/data/dmdcr.ini -p dsc1
Created symlink from /etc/systemd/system/multi-user.target.wants/DmCSSServicedsc1.service to /usr/lib/systemd/system/DmCSSServicedsc1.service.
创建服务(DmCSSServicedsc1)完成
#DMASM
[root@dameng1 bin]# /dm/dmdbms/script/root/dm_service_installer.sh -t dmasmsvr -dcr_ini /dm/data/dmdcr.ini -p dsc1 -y DmCSSServicedsc1
Created symlink from /etc/systemd/system/multi-user.target.wants/DmASMSvrServicedsc1.service to /usr/lib/systemd/system/DmASMSvrServicedsc1.service.
创建服务(DmASMSvrServicedsc1)完成
节点DSC2:
#DMCSS:
[root@dameng2 data]# /dm/dmdbms/script/root/dm_service_installer.sh -t dmcss -dcr_ini /dm/data/dmdcr.ini -p dsc2
Created symlink from /etc/systemd/system/multi-user.target.wants/DmCSSServicedsc2.service to /usr/lib/systemd/system/DmCSSServicedsc2.service.
创建服务(DmCSSServicedsc2)完成
#DMASM
[root@dameng2 data]# /dm/dmdbms/script/root/dm_service_installer.sh -t dmasmsvr -dcr_ini /dm/data/dmdcr.ini -p dsc2 -y DmCSSServicedsc2
Created symlink from /etc/systemd/system/multi-user.target.wants/DmASMSvrServicedsc2.service to /usr/lib/systemd/system/DmASMSvrServicedsc2.service.
创建服务(DmASMSvrServicedsc2)完成
2） 启动DMCSS和DMASM 服务
节点1：
[root@dameng1 bin]# systemctl start DmCSSServicedsc1.service
节点2：
[root@dameng2 bin]# systemctl start DmCSSServicedsc2.service
节点1
[root@dameng1 bin]# systemctl start DmASMSvrServicedsc1.service
节点2：
[root@dameng2 bin]# systemctl start DmASMSvrServicedsc2.service
2.创建数据库
1）准备配置文件dminit.ini
[root@dameng1 data]# vi /dm/data/dminit.ini
db_name = dsc
system_path = +DMDATA/data
system = +DMDATA/data/dsc/system.dbf
system_size = 128
roll = +DMDATA/data/dsc/roll.dbf
roll_size = 128
main = +DMDATA/data/dsc/main.dbf
main_size = 128
ctl_path = +DMDATA/data/dsc/dm.ctl
ctl_size = 8
log_size = 256
dcr_path = /dev/raw/raw1 #dcr 磁盘路径，目前不支持 asm，只能是裸设备
dcr_seqno = 0
auto_overwrite = 1
[DSC0] #inst_name 跟 dmdcr_cfg.ini 中 DB 类型 group 中 DCR_EP_NAME 对应
config_path = /dm/data/dsc0_config
port_num = 5236
mal_host = 192.168.71.131
mal_port = 9340
log_path = +DMLOG/log/dsc0_log01.log
log_path = +DMLOG/log/dsc0_log02.log
[DSC1] #inst_name 跟 dmdcr_cfg.ini 中 DB 类型 group 中 DCR_EP_NAME 对应
config_path = /dm/data/dsc1_config
port_num = 5236
mal_host = 192.168.71.132
mal_port = 9341
log_path = +DMLOG/log/dsc1_log01.log
log_path = +DMLOG/log/dsc1_log02.log
[root@dameng1 data]# ll
total 16
-rw-r--r--. 1 root root 150 Nov 6 07:16 dmasvrmal.ini
-rw-r--r--. 1 root root 961 Nov 6 07:22 dmdcr_cfg.ini
-rw-r--r--. 1 root root 408 Nov 6 07:25 dmdcr.ini
-rw-r--r--. 1 root root 868 Nov 6 07:40 dminit.ini
[root@dameng1 data]# chown -R dmdba.dinstall *
- 创建数据库
[root@dameng1 bin]# su - dmdba
[dmdba@dameng1 ~]$ cd /dm/dmdbms/bin
[dmdba@dameng1 bin]$ ./dminit control=/dm/data/dminit.ini
initdb V8
db version: 0x7000a
file dm.key not found, use default license!
License will expire on 2021-06-24
log file path: +DMLOG/log/dsc0_log01.log
log file path: +DMLOG/log/dsc0_log02.log
log file path: +DMLOG/log/dsc1_log01.log
log file path: +DMLOG/log/dsc1_log02.log
write to dir [+DMDATA/data/dsc].
create dm database success. 2020-11-06 07:41:20
- 启动数据库
[dmdba@dameng1 bin]$ ./dmserver /dm/data/dsc0_config/dm.ini dcr_ini=/dm/data/dmdcr.ini
file dm.key not found, use default license!
version info: develop
Use normal os_malloc instead of HugeTLB
Use normal os_malloc instead of HugeTLB
DM Database Server x64 V8 1-1-88-20.06.24-123627-ENT startup...
Database mode = 0, oguid = 0
License will expire on 2021-06-24
将dsc1_config传到节点2
[dmdba@dameng1 ~]$ cd /dm/data/
[dmdba@dameng1 data]$ ll
total 16
-rw-r--r--. 1 dmdba dinstall 150 Nov 6 07:16 dmasvrmal.ini
-rw-r--r--. 1 dmdba dinstall 961 Nov 6 07:22 dmdcr_cfg.ini
-rw-r--r--. 1 dmdba dinstall 408 Nov 6 07:25 dmdcr.ini
-rw-r--r--. 1 dmdba dinstall 868 Nov 6 07:40 dminit.ini
drwxr-xr-x. 2 dmdba dinstall 87 Nov 6 07:41 dsc0_config
drwxr-xr-x. 2 dmdba dinstall 55 Nov 6 07:41 dsc1_config
[dmdba@dameng1 data]$ scp -r dsc1_config dmdba@192.168.83.132:/dm/data/
The authenticity of host '192.168.83.132 (192.168.83.132)' can't be established.
ECDSA key fingerprint is SHA256:8QOkseBMwz+jNPE42wK9fd4sNg09PwBgtx1+iONLHgY.
ECDSA key fingerprint is MD5:d1:99:6f:c5:eb:bc:9d:39:8f:d8:c3:89:4e:3f:12:dd.
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added '192.168.83.132' (ECDSA) to the list of known hosts.
dmdba@192.168.83.132's password:
dmmal.ini 100% 208 354.6KB/s 00:00
dm.ini 100% 48KB 2.1MB/s 00:00
sqllog.ini 100% 479 938.1KB/s 00:00
[dmdba@dameng1 data]$
- 注册数据库服务
在2个节点分别注册DM 数据库服务：
[root@dameng1 bin]# /dm//dmdbms/script/root/dm_service_installer.sh -t dmserver -dm_ini /dm/data/dsc0_config/dm.ini -dcr_ini /dm/data/dmdcr.ini -p dsc1 -y DmASMSvrServicedsc1
Created symlink from /etc/systemd/system/multi-user.target.wants/DmServicedsc1.service to /usr/lib/systemd/system/DmServicedsc1.service.
创建服务(DmServicedsc1)完成
[root@dameng2 data]# /dm//dmdbms/script/root/dm_service_installer.sh -t dmserver -dm_ini /dm/data/dsc1_config/dm.ini -dcr_ini /dm/data/dmdcr.ini -p dsc2 -y DmASMSvrServicedsc2
Created symlink from /etc/systemd/system/multi-user.target.wants/DmServicedsc2.service to /usr/lib/systemd/system/DmServicedsc2.service.
创建服务(DmServicedsc2)完成
- 启动数据库
[root@dameng1 bin]# systemctl start DmServicedsc1
[root@dameng2 data]# systemctl start DmServicedsc2
3.连接数据库测试
1）配置dm_svc.conf文件
[root@dameng1 bin]# vim /etc/dm_svc.conf
dsc=(192.168.83.131:5236,192.168.83.132:5236)
SWITCH_TIME=(3)
SWITCH_INTERVAL=(100)
TIME_ZONE=(480)
LANGUAGE=(cn)
2）使用连接串连接
[root@dameng1 bin]# ./disql SYSDBA/SYSDBA@dsc
服务器[192.168.83.131:5236]:处于普通打开状态
登录使用时间: 17.727(毫秒)
disql V8
SQL>
SQL> select * from v$dsc_ep_info;
行号 EP_NAME EP_SEQNO EP_GUID EP_TIMESTAMP EP_MODE EP_STATUS
---------- ------- ----------- -------------------- -------------------- ------------ ---------
1 DSC0 0 323073163 323073660 Control Node OK
2 DSC1 1 323085767 323086196 Normal Node OK
已用时间: 2.187(毫秒). 执行号:503.
SQL>
736
被折叠的 条评论
为什么被折叠?
到【灌水乐园】发言
