达梦8 DSC（ASM）搭建

一、环境说明

机器	IP	实例名称	端口	操作系统	数据库版本
A	192.168.189.130 192.168.179.130	DSC0	5236	Red Hat Enterprise Linux Server release 6.9 (Santiago)	DM8
B	192.168.189.131 192.168.179.131	DSC1	5237	Red Hat Enterprise Linux Server release 6.9 (Santiago)	DM8

二、配置共享存储（vmvare workstation）

参考文档：https://blog.csdn.net/suyishuai/article/details/30974917

修改DM_DSC_P.vmx
先看原文件
-***********上面省去N行******************
usb:1.parent = "-1"
ide1:0.startConnected = "TRUE"
tools.syncTime = "FALSE"
tools.remindInstall = "FALSE"
toolsInstallManager.updateCounter = "1"
unity.wasCapable = "FALSE"
ethernet0.vnet = "VMnet1"
ethernet0.connectionType = "custom"
scsi0:1.present = "TRUE"
scsi0:1.fileName = "001-000001.vmdk"
scsi0:1.redo = ""
usb:0.present = "TRUE"
usb:0.deviceType = "hid"

usb:0.port = "0"
usb:0.parent = "-1"
scsi1.present = "TRUE" --从这行开始修改
scsi1.virtualDev = "lsilogic"
scsi1:1.present = "TRUE"
scsi1:1.fileName = "G:\shareDisk\001.vmdk"
scsi1:1.mode = "independent-persistent"
scsi1:2.present = "TRUE"
scsi1:2.fileName = "G:\shareDisk\002.vmdk"
scsi1:2.mode = "independent-persistent"
floppy0.present = "FALSE"

修改后：

scsi1.present = "TRUE"
scsi1.virtualDev = "lsilogic"
scsi1.sharedBus = "virtual" --新加的
scsi1:1.present = "TRUE"
scsi1:1.fileName = "G:\shareDisk\001.vmdk"
scsi1:1.mode = "independent-persistent"
scsi1:1.deviceType = "disk"--新加的
scsi1:2.present = "TRUE"
scsi1:2.fileName = "G:\shareDisk\002.vmdk"
scsi1:2.mode = "independent-persistent"
scsi1:2.deviceType = "disk"--新加的
floppy0.present = "FALSE"
disk.locking = "false"  --新加的
diskLib.dataCacheMaxSize = "0"  --新加的
diskLib.dataCacheMaxReadAheadSize = "0"  --新加的
diskLib.DataCacheMinReadAheadSize = "0"  --新加的
diskLib.dataCachePageSize = "4096"  --新加的
diskLib.maxUnsyncedWrites = "0"  --新加的
disk.EnableUUID = "TRUE" --新加的
另一台DM_DSC_S.vmx通样需要修改，重启之后就可以使用了

三、进行裸设备划分绑定

绑定裸设备
编辑 /etc/udev/rules.d/60-raw.rules 文件，将以下内容添加至文件，两台节点均需操作
 vi /etc/udev/rules.d/60-raw.rules
ACTION=="add", KERNEL=="sdb1", RUN+="/bin/raw /dev/raw/raw1 %N"
ACTION=="add", KERNEL=="sdb2", RUN+="/bin/raw /dev/raw/raw2 %N"
ACTION=="add", KERNEL=="sdb3", RUN+="/bin/raw /dev/raw/raw3 %N"
ACTION=="add", KERNEL=="sdb4", RUN+="/bin/raw /dev/raw/raw4 %N"
ACTION=="add", KERNEL=="raw[1-4]", OWNER="root", GROUP="root", MODE="660"

Dsc0： # partprobe /dev/sdb #start_udev
Dsc1： # partprobe /dev/sdb #start_udev
raw -qa blockdev --getsize64 /dev/raw/raw1
raw -qa blockdev --getsize64 /dev/raw/raw2
raw -qa blockdev --getsize64 /dev/raw/raw3
raw -qa blockdev --getsize64 /dev/raw/raw4

四、配置数据库软件

配置操作系统参数以及安装数据库软件，参考https://blog.csdn.net/beatlove123/article/details/110489366

五、配置共享集群

5.1 配置dmdcr_cfg.ini，后续 DMASMCMD 工具执行 init 语句会使用到。

[dmdba@RH6 dmdata]$ cat dmdcr_cfg.ini 
DCR_N_GRP = 3
DCR_VTD_PATH = /dev/raw/raw2
DCR_OGUID = 63635
[GRP]
DCR_GRP_TYPE = CSS
DCR_GRP_NAME = GRP_CSS
DCR_GRP_N_EP = 2
DCR_GRP_DSKCHK_CNT = 60
[GRP_CSS]
DCR_EP_NAME = CSS0
DCR_EP_HOST = 192.168.189.130
DCR_EP_PORT = 9341
[GRP_CSS]
DCR_EP_NAME = CSS1
DCR_EP_HOST = 192.168.189.131
DCR_EP_PORT = 9343
[GRP]
DCR_GRP_TYPE = ASM
DCR_GRP_NAME = GRP_ASM
DCR_GRP_N_EP = 2
DCR_GRP_DSKCHK_CNT = 60
[GRP_ASM]
DCR_EP_NAME = ASM0
DCR_EP_SHM_KEY = 93360
DCR_EP_SHM_SIZE = 20
DCR_EP_HOST = 192.168.189.130
DCR_EP_PORT = 9349
DCR_EP_ASM_LOAD_PATH = /dev/raw
[GRP_ASM]
DCR_EP_NAME = ASM1
DCR_EP_SHM_KEY = 93361
DCR_EP_SHM_SIZE = 20
DCR_EP_HOST = 192.168.189.131
DCR_EP_PORT = 9351
DCR_EP_ASM_LOAD_PATH = /dev/raw
[GRP]
DCR_GRP_TYPE = DB
DCR_GRP_NAME = GRP_DSC
DCR_GRP_N_EP = 2
DCR_GRP_DSKCHK_CNT = 60
[GRP_DSC]
DCR_EP_NAME = DSC0
DCR_EP_SEQNO = 0
DCR_EP_PORT = 5236
DCR_CHECK_PORT = 9741
[GRP_DSC]
DCR_EP_NAME = DSC1
DCR_EP_SEQNO = 1
DCR_EP_PORT = 5237
DCR_CHECK_PORT = 9742

5.2 使用 DMASMCMD 工具初始化

[dmdba@RH6 bin]$ ./dmasmcmd 
DMASMCMD V8
ASM>
ASM>
ASM>create dcrdisk '/dev/raw/raw1' 'dcr'
[Trace]The ASM initialize dcrdisk /dev/raw/raw1 to name DMASMdcr
Used time: 16.764(ms).
ASM>create votedisk '/dev/raw/raw2' 'vote'
[Trace]The ASM initialize votedisk /dev/raw/raw2 to name DMASMvote
Used time: 15.160(ms).
ASM>create asmdisk '/dev/raw/raw3' 'LOG0'
[Trace]The ASM initialize asmdisk /dev/raw/raw3 to name DMASMLOG0
Used time: 13.985(ms).
ASM>create asmdisk '/dev/raw/raw4' 'DATA0'
[Trace]The ASM initialize asmdisk /dev/raw/raw4 to name DMASMDATA0
Used time: 2.999(ms).
ASM>init dcrdisk '/dev/raw/raw1' from '/home/dmdba/dmdata/dmdcr_cfg.ini'identified by 'abcd'
[Trace]DG 126 allocate 4 extents for file 0xfe000002.
Used time: 71.753(ms).
ASM>init votedisk '/dev/raw/raw2' from '/home/dmdba/dmdata/dmdcr_cfg.ini'
[Trace]DG 125 allocate 4 extents for file 0xfd000002.
Used time: 36.490(ms).

5.3 配置dmasvrmal.ini，所有节点配置一样

[MAL_INST1] 
MAL_INST_NAME = ASM0 
MAL_HOST = 192.168.189.130 
MAL_PORT = 7236 
[MAL_INST2] 
MAL_INST_NAME = ASM1 
MAL_HOST = 192.168.189.131 
MAL_PORT = 7237

5.4 配置dmdcr.ini

节点一130配置dmdcr.ini
[dmdba@RH6 dmdata]$ cat dmdcr.ini 
DMDCR_PATH = /dev/raw/raw1
DMDCR_MAL_PATH = /home/dmdba/dmdata/dmasvrmal.ini
DMDCR_SEQNO = 1

DMDCR_ASM_RESTART_INTERVAL = 0  
DMDCR_ASM_STARTUP_CMD = /home/dmdba/dm8/dmdbms/bin/dmasmsvr dcr_ini=/home/dmdba/dmdata/dmdcr.ini

DMDCR_DB_RESTART_INTERVAL = 0  
DMDCR_DB_STARTUP_CMD = /home/dmdba/dm8/dmdbms/bin/dmserver path=/home/dmdba/dmdata/dsc1_config/dm.ini dcr_ini=/home/dmdba/dmdata/dmdcr.ini 

节点二131配置 dmdcr.ini
[dmdba@RH6 dmdata]$ cat dmdcr.ini 
DMDCR_PATH = /dev/raw/raw1
DMDCR_MAL_PATH = /home/dmdba/dmdata/dmasvrmal.ini
DMDCR_SEQNO = 1

DMDCR_ASM_RESTART_INTERVAL = 0  
DMDCR_ASM_STARTUP_CMD = /home/dmdba/dm8/dmdbms/bin/dmasmsvr dcr_ini=/home/dmdba/dmdata/dmdcr.ini

DMDCR_DB_RESTART_INTERVAL = 0  
DMDCR_DB_STARTUP_CMD = /home/dmdba/dm8/dmdbms/bin/dmserver path=/home/dmdba/dmdata/dsc1_config/dm.ini dcr_ini=/home/dmdba/dmdata/dmdcr.ini 

5.5启动 DMCSS、DMASM 服务程序

在192.168.189.130、192.168.189.131 节点先后分别启动 dmcss、dmasmsvr 程序
192.168.189.130节点一：
手动启动 dmcss 命令：
[dmdba@RH6 bin]$ ./dmcss DCR_INI=/home/dmdba/dmdata/dmdcr.ini 
DMCSS V8
DMCSS IS READY
[CSS]: 设置EP CSS0[0]为控制节点
[ASM]: 设置EP ASM0[0]为控制节点
[ASM]: 设置命令[START NOTIFY], 目标站点 ASM0[0], 命令序号[2]
[ASM]: 设置命令[EP START], 目标站点 ASM0[0], 命令序号[3]
[ASM]: 设置命令[NONE], 目标站点 ASM0[0], 命令序号[0]
[ASM]: 设置命令[EP START], 目标站点 ASM1[1], 命令序号[5]
[ASM]: 设置命令[NONE], 目标站点 ASM1[1], 命令序号[0]
[ASM]: 设置命令[EP OPEN], 目标站点 ASM0[0], 命令序号[8]
[ASM]: 设置命令[EP OPEN], 目标站点 ASM1[1], 命令序号[9]
[ASM]: 设置命令[NONE], 目标站点 ASM0[0], 命令序号[0]
[ASM]: 设置命令[NONE], 目标站点 ASM1[1], 命令序号[0]
[ASM]: 设置命令[EP REAL OPEN], 目标站点 ASM0[0], 命令序号[11]
[ASM]: 设置命令[EP REAL OPEN], 目标站点 ASM1[1], 命令序号[12]
[ASM]: 设置命令[NONE], 目标站点 ASM0[0], 命令序号[0]
[ASM]: 设置命令[NONE], 目标站点 ASM1[1], 命令序号[0]

手动启动 dmasmsvr 命令：

[dmdba@RH6 bin]$ ./dmasmsvr DCR_INI=/home/dmdba/dmdata/dmdcr.ini 
ASM SELF EPNO:0
DMASMSVR V8
dmasmsvr task worker thread startup
the ASM server is Ready.
check css cmd: START NOTIFY, cmd_seq: 2
check css cmd: EP START, cmd_seq: 3
ASM Control Node EPNO:0
check css cmd: EP OPEN, cmd_seq: 8
check css cmd: EP REAL OPEN, cmd_seq: 11

192.168.189.131节点二

[dmdba@RH6 bin]$ ./dmcss DCR_INI=/home/dmdba/dmdata/dmdcr.ini 
DMCSS V8
DMCSS IS READY
[CSS]: 设置EP CSS0[0]为控制节点

[dmdba@RH6 bin]$ ./dmasmsvr DCR_INI=/home/dmdba/dmdata/dmdcr.ini 

ASM SELF EPNO:1
DMASMSVR V8
dmasmsvr task worker thread startup
the ASM server is Ready.
check css cmd: EP START, cmd_seq: 5

ASM Control Node EPNO:0
check css cmd: EP OPEN, cmd_seq: 9
check css cmd: EP REAL OPEN, cmd_seq: 12
[Trace]asm_disk_add: /dev/raw/raw3
[Trace]asm_disk_add: /dev/raw/raw4
[Trace]atsk_process_connect success, client_is_local=1
[Trace]asvr2_sess_free sess:(0xbc000920), tsk:(0x22867b0).
[Trace]atsk_process_connect success, client_is_local=1

5.6使用dmasmtool 工具创建 DMASM 磁盘组

选择一个节点（192.168.189.130），启动 dmasmtool 工具。 
dmdba@RH6 bin]$ ./dmasmtool DCR_INI=/home/dmdba/dmdata/dmdcr.ini 
DMASMTOOL V8
ASM>
ASM>
ASM>
ASM>create diskgroup 'DMLOG' asmdisk '/dev/raw/raw3'
Used time: 27.507(ms).
ASM>create diskgroup 'DMDATA' asmdisk '/dev/raw/raw4'
Used time: 28.626(ms).
ASM>exit

5.7 配置dminit.ini ，保存到/home/dmdba/dmdata/进行初始化

[dmdba@RH6 dmdata]$ cat dminit.ini 
db_name = dsc
system_path = +DMDATA/data
system = +DMDATA/data/dsc/system.dbf
system_size = 128
roll = +DMDATA/data/dsc/roll.dbf
roll_size = 128
main = +DMDATA/data/dsc/main.dbf
main_size = 128
ctl_path = +DMDATA/data/dsc/dm.ctl
ctl_size = 8
log_size = 256
dcr_path = /dev/raw/raw1 #dcr 磁盘路径，目前不支持 asm，只能是裸设备
dcr_seqno = 0
auto_overwrite = 1
[DSC0] #inst_name 跟 dmdcr_cfg.ini 中 DB 类型 group 中 DCR_EP_NAME 对应
config_path = /home/dmdba/dmdata/dsc0_config
port_num = 5236
mal_host = 192.168.189.130
mal_port = 9340
log_path = +DMLOG/log/dsc0_log01.log
log_path = +DMLOG/log/dsc0_log02.log
[DSC1] #inst_name 跟 dmdcr_cfg.ini 中 DB 类型 group 中 DCR_EP_NAME 对应
config_path = /home/dmdba/dmdata/dsc1_config
port_num = 5237
mal_host = 192.168.189.131
mal_port = 9341
log_path = +DMLOG/log/dsc1_log01.log
log_path = +DMLOG/log/dsc1_log02.log

5.8 使用 dminit 初始化 DB 环境

选择一个节点（192.168.189.130），启动 dminit 工具初始化数据库。dminit 执行完成 后，会在 config_path 目录（/home/dmdba/dmdata/dsc0_config 和 
/home/dmdba/dmdata/dsc1_config）下生成配置文件 dm.ini 和 dmmal.ini。

[dmdba@RH6 bin]$ ./dminit control=/home/dmdba/dmdata/dminit.ini 
initdb V8
db version: 0x7000b
file dm.key not found, use default license!
License will expire on 2021-11-06

 log file path: +DMLOG/log/dsc0_log01.log


 log file path: +DMLOG/log/dsc0_log02.log


 log file path: +DMLOG/log/dsc1_log01.log


 log file path: +DMLOG/log/dsc1_log02.log

write to dir [+DMDATA/data/dsc].
create dm database success. 2020-12-10 00:20:06

5.9 启动数据库服务器

将 192.168.189.130 机器/home/data/dsc1_config 目录拷贝到 192.168.189.131 机器相 同目录下，再分别启动 dmserver 即可完成 DMDSC 集群搭建。 如果 DMCSS 配置有自动拉起 dmserver 的功能，可以等待 DMCSS 自动拉起实例，不 需要手动启动。 如果需要手动启动，可参考下面的操作步骤： 
192.168.189.130 机器： 
./dmserver /home/dmdba/dmdata/dsc0_config/dm.ini dcr_ini=/home/dmdba/dmdata/dmdcr.ini 
[dmdba@RH6 bin]$ ./dmserver /home/dmdba/dmdata/dsc0_config/dm.ini dcr_ini=/home/dmdba/dmdata/dmdcr.ini
file dm.key not found, use default license!
version info: develop
Use normal os_malloc instead of HugeTLB
Use normal os_malloc instead of HugeTLB
DM Database Server x64 V8 1-1-144-20.11.06-129436-ENT  startup...
Database mode = 0, oguid = 0
License will expire on 2021-11-06
check CSS cmd: START NOTIFY, cmd_seq: 2
Control Node change from 255 to 254
check CSS cmd: DCR_LOAD, cmd_seq: 3
check CSS cmd: EP START, cmd_seq: 6
Control Node change from 254 to 0
file lsn: 0
check CSS cmd: EP START2, cmd_seq: 11
ndct db load finished
ckpt2_exec_immediately begin.

192.168.189.131 机器： 
./dmserver /home/dmdba/dmdata/dsc1_config/dm.ini dcr_ini=/home/dmdba/dmdata/dmdcr.ini
[dmdba@RH6 bin]$ ./dmserver /home/dmdba/dmdata/dsc1_config/dm.ini dcr_ini=/home/dmdba/dmdata/dmdcr.ini 
file dm.key not found, use default license!
version info: develop
Use normal os_malloc instead of HugeTLB
Use normal os_malloc instead of HugeTLB
DM Database Server x64 V8 1-1-144-20.11.06-129436-ENT  startup...
Database mode = 0, oguid = 0
License will expire on 2021-11-06
check CSS cmd: DCR_LOAD, cmd_seq: 4
check CSS cmd: EP START, cmd_seq: 8
Control Node change from 255 to 0
mal_tsk_process_g_crash_lsn_bro, ep_seqno(0), crash_lsn(0)
mal_tsk_process_g_crash_lsn_bro, ep_seqno(1), crash_lsn(0)
check CSS cmd: EP START2, cmd_seq: 13
Control node start status: OPEN
file lsn: 0
ndct db load finished
ndct fill fast pool finished
ckpt2_exec_immediately begin.

5.10 数据验证：
在130中插入数据，131中可以查到数据，说明集群搭建完毕


更多资讯请上达梦技术社区了解： https://eco.dameng.com