达梦（DM7）共享存储集群DMDSC搭建

 

• DDAlex
•  
• 9
•  
• 2020-03-23 11:00

一、环境准备

 

主机	IP地址（对外服务）	IP地址（内部通信）	实例名	操作系统
dsc1	192.168.1.225	10.0.0.225	rac1	NeoKylin Linux 6.0
dsc2	192.168.1.226	10.0.0.225	rac2	NeoKylin Linux 6.0

 

共享存储
/dev/sdb	raw1	dcr disk	1G
/dev/sdc	raw2	voting disk	2G
/dev/sdd	raw3	log disk	8G
/dev/sde	raw4	data disk1	16G

 

二、操作系统配置

1、关闭防火墙和SELINUX

# service iptables stop

# chkconfig iptables off

# setenforce 0

# sed -i s:^SELINUX=.*$:SELINUX=disabled:g /etc/selinux/config

2、修改主机名

 

# hostname dsc1

# hostname dsc2

# sed -i s:^HOSTNAME=.*$:HOSTNAME=dsc1:g /etc/sysconfig/network

# sed -i s:^HOSTNAME=.*$:HOSTNAME=dsc2:g /etc/sysconfig/network

3、修改hosts文件

 

# echo "

192.168.1.225   dsc1

192.168.1.226   dsc2" >> /etc/hosts

4、设置文件最大打开数目

 

# ulimit -n 65536

# cat >> /etc/security/limits.conf << EOF

dmdba  soft  nofile  4096

dmdba  hard  nofile  65536

EOF

三、 安装达梦软件

1、创建安装用户

# groupadd dinstall

# useradd -g dinstall -m -d /home/dmdba -s /bin/bash dmdba

# echo "dmdba:dameng123" |chpasswd

2、创建相关安装目录

# mkdir -p /dm7/arch

# mkdir -p /dm7/backup

# chown -R dmdba:dinstall /dm7

# chmod -R 775 /dm7

3、安装达梦软件（DM7）

# mkdir /mnt/dmiso

# mount /tmp/dm7_setup_rh6_64_ent_7.6.0.197_20190917.iso /mnt/dmiso

# cp /mnt/dmiso/DMInstall.bin /tmp

# chown dmdba.dinstall /tmp/DMInstall.bin

# chmod 775 /tmp/DMInstall.bin

# su - dmdba

$ /mnt/dmiso/DMInstall.bin -i

选择安装目录 [/home/dmdba/dmdbms]:/dm7/dmdbms

请以root系统用户执行命令:

/dm7/dmdbms/script/root/root_installer.sh

4、配置环境变量

$ cat >> ~/.bash_profile << EOF

export PATH=\$DM_HOME/bin:\$DM_HOME/tool:\$PATH

EOF

四、绑定UDEV

1、执行udev绑定脚本

# for i in b c d e;

do

echo "KERNEL==\"sd*\", BUS==\"scsi\",PROGRAM==\"/sbin/scsi_id -g -u /dev/\$name\", 

RESULT==\"`/sbin/scsi_id -g -u /dev/sd$i`\", NAME=\"asm-disk$i\", OWNER=\"dmdba\",

GROUP=\"dinstall\", MODE=\"0660\"" >> /etc/udev/rules.d/99-dm-devices.rules

done

 

2、重启UDEV后，查看绑定状态

# start_udev

# ll /dev/asm-*

五、绑定raw设备

# chmod +x /etc/rc.d/rc.local

# vi /etc/rc.d/rc.local

-----------------------------------------------------------------

raw /dev/raw/raw1 /dev/asm-diskb

chown dmdba:dinstall /dev/raw/raw1

chmod 660 /dev/raw/raw1

raw /dev/raw/raw2 /dev/asm-diskc

chown dmdba:dinstall /dev/raw/raw2

chmod 660 /dev/raw/raw2

raw /dev/raw/raw3 /dev/asm-diskd

chown dmdba:dinstall /dev/raw/raw3

chmod 660 /dev/raw/raw3

raw /dev/raw/raw4 /dev/asm-diske

chown dmdba:dinstall /dev/raw/raw4

chmod 660 /dev/raw/raw4

touch /var/lock/subsys/local

六、配置dmdcr_cfg.ini文件

# su - dmdba

$ mkdir /dm7/dmdbms/data

$ vim /dm7/dmdbms/data/dmdcr_cfg.ini

-----------------------------------------------------------------

DCR_N_GRP = 3

DCR_VTD_PATH = /dev/raw/raw2

DCR_OGUID = 63635

[GRP]

DCR_GRP_TYPE = CSS

DCR_GRP_NAME = GRP_CSS

DCR_GRP_N_EP = 2

DCR_GRP_DSKCHK_CNT = 60

[GRP_CSS]

DCR_EP_NAME = CSS0

DCR_EP_HOST = 10.0.0.225

DCR_EP_PORT = 9541

[GRP_CSS]

DCR_EP_NAME = CSS1

DCR_EP_HOST = 10.0.0.226

DCR_EP_PORT = 9542

[GRP]

DCR_GRP_TYPE = ASM

DCR_GRP_NAME = GRP_ASM

DCR_GRP_N_EP = 2

DCR_GRP_DSKCHK_CNT = 60

[GRP_ASM]

DCR_EP_NAME = ASM0

DCR_EP_SHM_KEY = 93360

DCR_EP_SHM_SIZE = 10

DCR_EP_HOST = 192.168.1.225

DCR_EP_PORT = 9641

DCR_EP_ASM_LOAD_PATH = /dev/raw

[GRP_ASM]

DCR_EP_NAME = ASM1

DCR_EP_SHM_KEY = 93361

DCR_EP_SHM_SIZE = 10

DCR_EP_HOST = 192.168.1.226

DCR_EP_PORT = 9642

DCR_EP_ASM_LOAD_PATH = /dev/raw

[GRP]

DCR_GRP_TYPE = DB

DCR_GRP_NAME = GRP_RAC

DCR_GRP_N_EP = 2

DCR_GRP_DSKCHK_CNT = 60

[GRP_RAC]

DCR_EP_NAME = RAC0

DCR_EP_SEQNO = 0

DCR_EP_PORT = 5236

DCR_CHECK_PORT = 9741

[GRP_RAC]

DCR_EP_NAME = RAC1

DCR_EP_SEQNO = 1

DCR_EP_PORT = 5236

DCR_CHECK_PORT = 9742

七、使用 DMASMCMD 工具初始化（任意一节点执行）

$ dmasmcmd

ASM> create dcrdisk '/dev/raw/raw1' 'dcr'

ASM> create votedisk '/dev/raw/raw2' 'vote'

ASM> create asmdisk '/dev/raw/raw3' 'LOG0'

ASM> create asmdisk '/dev/raw/raw4' 'DATA0'

ASM> init dcrdisk '/dev/raw/raw1' from '/dm7/dmdbms/data/dmdcr_cfg.ini' identified by 'dameng123'

ASM> init votedisk '/dev/raw/raw2' from '/dm7/dmdbms/data/dmdcr_cfg.ini'

八、准备DMASM 的 MAL 配置文件

$ vi /dm7/dmdbms/data/dmasvrmal.ini

------------------------------------------------------------------

[MAL_INST1]

MAL_INST_NAME = ASM0

MAL_HOST = 10.0.0.225

MAL_PORT = 7236

[MAL_INST2]

MAL_INST_NAME = ASM1

MAL_HOST = 10.0.0.226

MAL_PORT = 7237

九、准备dmdcr.ini 配置文件

节点一：

$ vi /dm7/dmdbms/data/dmdcr.ini

----------------------------------------------------------------------------------------------------------------------------

DMDCR_PATH = /dev/raw/raw1

DMDCR_MAL_PATH =/dm7/dmdbms/data/dmasvrmal.ini

DMDCR_SEQNO = 0

DMDCR_ASM_RESTART_INTERVAL = 0

DMDCR_ASM_STARTUP_CMD = /dm7/dmdbms/bin/dmasmsvr dcr_ini=/dm7/dmdbms/data/dmdcr.ini

DMDCR_DB_RESTART_INTERVAL = 0

DMDCR_DB_STARTUP_CMD = /dm7/dmdbms/bin/dmserver path=/dm7/dmdbms/data/rac0_config/dm.ini 

dcr_ini=/dm7/dmdbms/data/dmdcr.ini

节点二：

$ vi /dm7/dmdbms/data/dmdcr.ini

-----------------------------------------------------------------------------------------------------------------------------

DMDCR_PATH = /dev/raw/raw1

DMDCR_MAL_PATH =/dm7/dmdbms/data/dmasvrmal.ini

DMDCR_SEQNO = 1

DMDCR_ASM_RESTART_INTERVAL = 0

DMDCR_ASM_STARTUP_CMD = /dm7/dmdbms/bin/dmasmsvr dcr_ini=/dm7/dmdbms/data/dmdcr.ini

DMDCR_DB_RESTART_INTERVAL = 0

DMDCR_DB_STARTUP_CMD = /dm7/dmdbms/bin/dmserver path=/dm7/dmdbms/data/rac1_config/dm.ini 

dcr_ini=/dm7/dmdbms/data/dmdcr.ini

十、启动DMCSS、DMASM 服务程序

1、注册 DMCSS和DMASM服务

节点一：

# /dm7/dmdbms/script/root/dm_service_installer.sh -t dmcss -i /dm7/dmdbms/data/dmdcr.ini -p rac1

# /dm7/dmdbms/script/root/dm_service_installer.sh -t dmasmsvr -i /dm7/dmdbms/data/dmdcr.ini -p rac1 

-y DmCSSServicerac1

节点二：

# /dm7/dmdbms/script/root/dm_service_installer.sh -t dmcss -i /dm7/dmdbms/data/dmdcr.ini -p rac2

# /dm7/dmdbms/script/root/dm_service_installer.sh -t dmasmsvr -i /dm7/dmdbms/data/dmdcr.ini -p rac2 

-y DmCSSServicerac2

2、启动DMCSS和DMASM服务

节点一：

# service DmCSSServicerac1 start

# service DmASMSvrServicerac1 start

节点二：

# service DmCSSServicerac2 start

# service DmASMSvrServicerac2 start

十一、创建DMASM磁盘组

# su - dmdba

$ dmasmtool DCR_INI=/dm7/dmdbms/data/dmdcr.ini

ASM>create diskgroup 'DMLOG' asmdisk '/dev/raw/raw3'

ASM>create diskgroup 'DMDATA' asmdisk '/dev/raw/raw4'

十二、准备dminit.ini 配置文件

$ vi /dm7/dmdbms/data/dminit.ini

----------------------------------------------------------------------------------

db_name = rac

system_path = +DMDATA/data

system = +DMDATA/data/rac/system.dbf

system_size = 128

roll = +DMDATA/data/rac/roll.dbf

roll_size = 128

main = +DMDATA/data/rac/main.dbf

main_size = 128

ctl_path = +DMDATA/data/rac/dm.ctl

ctl_size = 8

log_size = 256

dcr_path = /dev/raw/raw1

dcr_seqno = 0

auto_overwrite = 1

[RAC0]

config_path = /dm7/dmdbms/data/rac0_config

port_num = 5236

mal_host = 10.0.0.225

mal_port = 9340

log_path = +DMLOG/log/rac0_log01.log

log_path = +DMLOG/log/rac0_log02.log

[RAC1]

config_path = /dm7/dmdbms/data/rac1_config

port_num = 5236

mal_host = 10.0.0.226

mal_port = 9341

log_path = +DMLOG/log/rac1_log01.log

log_path = +DMLOG/log/rac1_log02.log

十三、使用dminit初始化数据库

$ dminit control=/dm7/dmdbms/data/dminit.ini

将节点一的配置文件复制到节点二：

$ cd /dm7/dmdbms/data

$ scp -r rac1_config dmdba@192.168.1.226:`pwd`

十四、启动数据库服务器

1、注册服务

节点一：

# /dm7/dmdbms/script/root/dm_service_installer.sh -t dmserver -i /dm7/dmdbms/data/rac0_config/dm.ini -d /dm7/dmdbms/data/dmdcr.ini -p rac1 -y DmASMSvrServicerac1

节点二：

# /dm7/dmdbms/script/root/dm_service_installer.sh -t dmserver -i /dm7/dmdbms/data/rac1_config/dm.ini -d /dm7/dmdbms/data/dmdcr.ini -p rac2 -y DmASMSvrServicerac2

2、启动数据库

# service DmServicerac1 start

# service DmServicerac2 start