前台业务反应HIS数据库1节点无法连接,2节点正常,通过远程的方式接入数据库查看得知,数据库1节点操作系统已经无法登陆,在服务器厂商的协助处理下,数据库服务器1节点操作系统可正常登陆,但是数据库集群、ASM、数据库等组件均启动失败。
通过堡垒机审计以及数据库日志分析等多维度综合评估判断,1节点已经失效,需要重新安装(即重新安装操作系统、重新安装数据库集群软件、重新安装数据库软件、节点删除并重新添加至集群)。
服务器厂商对HIS数据库1节点服务器重新安装操作系。我方对1节点开始数据库层面操作,操作步骤大致如下:
-
安装前准备
调整内核参数
创建目录
创建用户和用户组
修改环境变量
创建互信 -
节点剔除
-
安装数据库集群软件
-
安装数据库软件
-
添加节点至集群
-
处理步骤
由于安装前准备等同于数据库的初始安装配置,因此相关命令不再赘述。
3.1. 安装前准备
3.1.1. 调整内核参数
调整/etc/hosts、/etc/sysctl.conf等内核参数文件参数,保持与2节点一致。
3.1.2. 创建目录
创建ORACLE_BASE、ORACLE_HOME等目录,与2节点保持一致。
3.1.3. 创建用户和用户组
创建oracle、grid、oinstall、dba等用户和用户组,uid、gid等信息保持与2节点一致。
3.1.4. 修改环境变量
修改oracle、grid等用户的环境变量,与2节点保持一致。
3.1.5. 创建互信
由于远程环境无图形界面,因此需要手工建立互信,通过数据库集群件安装包下的sshUserset.sh脚本创建互信。
3.2. 节点剔除
3.2.1. 预检查
[root@oracle02 ~]# su - grid
[grid@oracle02 ~]$ /oracle/app/product/11.2.0/db_1/bin/cluvfy stage -pre crsinst -n oracle01,oracle02 -verbose
Performing pre-checks for cluster services setup
Checking node reachability...
Check: Node reachability from node "oracle02"
Destination Node Reachable?
------------------------------------ ------------------------
oracle01 yes
oracle02 yes
Result: Node reachability check passed from node "oracle02"
Checking user equivalence...
Check: User equivalence for user "grid"
Node Name Status
------------------------------------ ------------------------
oracle02 passed
oracle01 passed
Result: User equivalence check passed for user "grid"
Checking node connectivity...
Checking hosts config file...
Node Name Status
------------------------------------ ------------------------
oracle02 passed
oracle01 passed
Verification of the hosts config file successful
Interface information for node "oracle02"
Name IP Address Subnet Gateway Def. Gateway HW Address MTU
------ --------------- --------------- --------------- --------------- ----------------- ------
***
Interface information for node "oracle01"
Name IP Address Subnet Gateway Def. Gateway HW Address MTU
------ --------------- --------------- --------------- --------------- ----------------- ------
***
Check: Node connectivity for interface "bond0"
Source Destination Connected?
------------------------------ ------------------------------ ----------------
***
Result: Node connectivity passed for interface "bond0"
Check: TCP connectivity of subnet "172.16.18.0"
Source Destination Connected?
------------------------------ ------------------------------ ----------------
***
Check: Node connectivity for interface "bond1"
Source Destination Connected?
------------------------------ ------------------------------ ----------------
***
Check: TCP connectivity of subnet "2.2.2.0"
Source Destination Connected?
------------------------------ ------------------------------ ----------------
***
Checking subnet mask consistency...
Subnet mask consistency check passed for subnet "*".
Subnet mask consistency check passed for subnet "*".
Subnet mask consistency check passed.
Result: Node connectivity check passed
Checking multicast communication...
Checking subnet "172.16.18.0" for multicast communication with multicast group "230.0.1.0"...
Check of subnet "172.16.18.0" for multicast communication with multicast group "230.0.1.0" passed.
Checking subnet "2.2.2.0" for multicast communication with multicast group "230.0.1.0"...
Check of subnet "2.2.2.0" for multicast communication with multicast group "230.0.1.0" passed.
Check of multicast communication passed.
Checking ASMLib configuration.
Node Name Status
------------------------------------ ------------------------
oracle02 passed
oracle01 passed
Result: Check for ASMLib configuration passed.
Check: Total memory
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
oracle02 504.5993GB (5.29110668E8KB) 1.5GB (1572864.0KB) passed
oracle01 504.5991GB (5.29110532E8KB) 1.5GB (1572864.0KB) passed
Result: Total memory check passed
Check: Available memory
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
oracle02 264.0379GB (2.76863852E8KB) 50MB (51200.0KB) passed
oracle01 270.6703GB (2.83818404E8KB) 50MB (51200.0KB) passed
Result: Available memory check passed
Check: Swap space
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
oracle02 62.5GB (6.5535996E7KB) 16GB (1.6777216E7KB) passed
oracle01 62.5GB (6.5535996E7KB) 16GB (1.6777216E7KB) passed
Result: Swap space check passed
Check: Free disk space for "oracle02:/oracle/grid/crs_1"
Path Node Name Mount point Available Required Status
---------------- ------------ ------------ ------------ ------------ ------------
/oracle/grid/crs_1 oracle02 /oracle 47.3369GB 5.5GB passed
Result: Free disk space check passed for "oracle02:/oracle/grid/crs_1"
Check: Free disk space for "oracle01:/oracle/grid/crs_1"
Path Node Name Mount point Available Required Status
---------------- ------------ ------------ ------------ ------------ ------------
/oracle/grid/crs_1 oracle01 /oracle 68.3945GB 5.5GB passed
Result: Free disk space check passed for "oracle01:/oracle/grid/crs_1"
Check: Free disk space for "oracle02:/tmp"
Path Node Name Mount point Available Required Status
---------------- ------------ ------------ ------------ ------------ ------------
/tmp oracle02 / 92.4619GB 1GB passed
Result: Free disk space check passed for "oracle02:/tmp"
Check: Free disk space for "oracle01:/tmp"
Path Node Name Mount point Available Required Status
---------------- ------------ ------------ ------------ ------------ ------------
/tmp oracle01 / 87.1504GB 1GB passed
Result: Free disk space check passed for "oracle01:/tmp"
Check: User existence for "grid"
Node Name Status Comment
------------ ------------------------ ------------------------
oracle02 passed exists(3001)
oracle01 passed exists(3001)
Checking for multiple users with UID value 3001
Result: Check for multiple users with UID value 3001 passed
Result: User existence check passed for "grid"
Check: Group existence for "oinstall"
Node Name Status Comment
------------ ------------------------ ------------------------
oracle02 passed exists
oracle01 passed exists
Result: Group existence check passed for "oinstall"
Check: Group existence for "dba"
Node Name Status Comment
------------ ------------------------ ------------------------
oracle02 passed exists
oracle01 passed exists
Result: Group existence check passed for "dba"
Check: Membership of user "grid" in group "oinstall" [as Primary]
Node Name User Exists Group Exists User in Group Primary Status
---------------- ------------ ------------ ------------ ------------ ------------
oracle02 yes yes yes yes passed
oracle01 yes yes yes yes passed
Result: Membership check for user "grid" in group "oinstall" [as Primary] passed
Check: Membership of user "grid" in group "dba"
Node Name User Exists Group Exists User in Group Status
---------------- ------------ ------------ ------------ ----------------
oracle02 yes yes yes passed
oracle01 yes yes yes passed
Result: Membership check for user "grid" in group "dba" passed
Check: Run level
Node Name run level Required Status
------------ ------------------------ ------------------------ ----------
oracle02 5 3,5 passed
oracle01 3 3,5 passed
Result: Run level check passed
Check: Hard limits for "maximum open file descriptors"
Node Name Type Available Required Status
---------------- ------------ ------------ ------------ ----------------
oracle02 hard 65536 65536 passed
oracle01 hard 65536 65536 passed
Result: Hard limits check passed for "maximum open file descriptors"
Check: Soft limits for "maximum open file descriptors"
Node Name Type Available Required Status
---------------- ------------ ------------ ------------ ----------------
oracle02 soft 1024 1024 passed
oracle01 soft 1024 1024 passed
Result: Soft limits check passed for "maximum open file descriptors"
Check: Hard limits for "maximum user processes"
Node Name Type Available Required Status
---------------- ------------ ------------ ------------ ----------------
oracle02 hard 16384 16384 passed
oracle01 hard 16384 16384 passed
Result: Hard limits check passed for "maximum user processes"
Check: Soft limits for "maximum user processes"
Node Name Type Available Required Status
---------------- ------------ ------------ ------------ ----------------
oracle02 soft 2047 2047 passed
oracle01 soft 2047 2047 passed
Result: Soft limits check passed for "maximum user processes"
Check: System architecture
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
oracle02 x86_64 x86_64 passed
oracle01 x86_64 x86_64 passed
Result: System architecture check passed
Check: Kernel version
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
oracle02 2.6.32-642.el6.x86_64 2.6.9 passed
oracle01 2.6.32-642.el6.x86_64 2.6.9 passed
Result: Kernel version check passed
Check: Kernel parameter for "semmsl"
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
oracle02 250 250 250 passed
oracle01 250 250 250 passed
Result: Kernel parameter check passed for "semmsl"
Check: Kernel parameter for "semmns"
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
oracle02 32000 32000 32000 passed
oracle01 32000 32000 32000 passed
Result: Kernel parameter check passed for "semmns"
Check: Kernel parameter for "semopm"
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
oracle02 100 100 100 passed
oracle01 100 100 100 passed
Result: Kernel parameter check passed for "semopm"
Check: Kernel parameter for "semmni"
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
oracle02 128 128 128 passed
oracle01 128 128 128 passed
Result: Kernel parameter check passed for "semmni"
Check: Kernel parameter for "shmmax"
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
oracle02 68719476736 68719476736 4294967295 passed
oracle01 68719476736 68719476736 4294967295 passed
Result: Kernel parameter check passed for "shmmax"
Check: Kernel parameter for "shmmni"
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
oracle02 4096 4096 4096 passed
oracle01 4096 4096 4096 passed
Result: Kernel parameter check passed for "shmmni"
Check: Kernel parameter for "shmall"
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
oracle02 4294967296 4294967296 2097152 passed
oracle01 4294967296 4294967296 2097152 passed
Result: Kernel parameter check passed for "shmall"
Check: Kernel parameter for "file-max"
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
oracle02 6815744 6815744 6815744 passed
oracle01 6815744 6815744 6815744 passed
Result: Kernel parameter check passed for "file-max"
Check: Kernel parameter for "ip_local_port_range"
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
oracle02 between 9000.0 & 65500.0 between 9000.0 & 65500.0 between 9000.0 & 65500.0 passed
oracle01 between 9000.0 & 65500.0 between 9000.0 & 65500.0 between 9000.0 & 65500.0 passed
Result: Kernel parameter check passed for "ip_local_port_range"
Check: Kernel parameter for "rmem_default"
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
oracle02 262144 262144 262144 passed
oracle01 262144 262144 262144 passed
Result: Kernel parameter check passed for "rmem_default"
Check: Kernel parameter for "rmem_max"
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
oracle02 4194304 4194304 4194304 passed
oracle01 4194304 4194304 4194304 passed
Result: Kernel parameter check passed for "rmem_max"
Check: Kernel parameter for "wmem_default"
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
oracle02 262144 262144 262144 passed
oracle01 262144 262144 262144 passed
Result: Kernel parameter check passed for "wmem_default"
Check: Kernel parameter for "wmem_max"
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
oracle02 1048576 1048576 1048576 passed
oracle01 1048576 1048576 1048576 passed
Result: Kernel parameter check passed for "wmem_max"
Check: Kernel parameter for "aio-max-nr"
Node Name Current Configured Required Status Comment
---------------- ------------ ------------ ------------ ------------ ------------
oracle02 1048576 1048576 1048576 passed
oracle01 1048576 1048576 1048576 passed
Result: Kernel parameter check passed for "aio-max-nr"
Check: Package existence for "make"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
oracle02 make-3.81-23.el6 make-3.80 passed
oracle01 make-3.81-23.el6 make-3.80 passed
Result: Package existence check passed for "make"
Check: Package existence for "binutils"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
oracle02 binutils-2.20.51.0.2-5.44.el6 binutils-2.15.92.0.2 passed
oracle01 binutils-2.20.51.0.2-5.44.el6 binutils-2.15.92.0.2 passed
Result: Package existence check passed for "binutils"
Check: Package existence for "gcc(x86_64)"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
oracle02 gcc(x86_64)-4.4.7-17.el6 gcc(x86_64)-3.4.6 passed
oracle01 gcc(x86_64)-4.4.7-17.el6 gcc(x86_64)-3.4.6 passed
Result: Package existence check passed for "gcc(x86_64)"
Check: Package existence for "libaio(x86_64)"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
oracle02 libaio(x86_64)-0.3.107-10.el6 libaio(x86_64)-0.3.105 passed
oracle01 libaio(x86_64)-0.3.107-10.el6 libaio(x86_64)-0.3.105 passed
Result: Package existence check passed for "libaio(x86_64)"
Check: Package existence for "glibc(x86_64)"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
oracle02 glibc(x86_64)-2.12-1.192.el6 glibc(x86_64)-2.3.4-2.41 passed
oracle01 glibc(x86_64)-2.12-1.192.el6 glibc(x86_64)-2.3.4-2.41 passed
Result: Package existence check passed for "glibc(x86_64)"
Check: Package existence for "compat-libstdc++-33(x86_64)"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
oracle02 compat-libstdc++-33(x86_64)-3.2.3-69.el6 compat-libstdc++-33(x86_64)-3.2.3 passed
oracle01 compat-libstdc++-33(x86_64)-3.2.3-69.el6 compat-libstdc++-33(x86_64)-3.2.3 passed
Result: Package existence check passed for "compat-libstdc++-33(x86_64)"
Check: Package existence for "elfutils-libelf(x86_64)"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
oracle02 elfutils-libelf(x86_64)-0.164-2.el6 elfutils-libelf(x86_64)-0.97 passed
oracle01 elfutils-libelf(x86_64)-0.164-2.el6 elfutils-libelf(x86_64)-0.97 passed
Result: Package existence check passed for "elfutils-libelf(x86_64)"
Check: Package existence for "elfutils-libelf-devel"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
oracle02 elfutils-libelf-devel-0.164-2.el6 elfutils-libelf-devel-0.97 passed
oracle01 elfutils-libelf-devel-0.164-2.el6 elfutils-libelf-devel-0.97 passed
Result: Package existence check passed for "elfutils-libelf-devel"
Check: Package existence for "glibc-common"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
oracle02 glibc-common-2.12-1.192.el6 glibc-common-2.3.4 passed
oracle01 glibc-common-2.12-1.192.el6 glibc-common-2.3.4 passed
Result: Package existence check passed for "glibc-common"
Check: Package existence for "glibc-devel(x86_64)"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
oracle02 glibc-devel(x86_64)-2.12-1.192.el6 glibc-devel(x86_64)-2.3.4 passed
oracle01 glibc-devel(x86_64)-2.12-1.192.el6 glibc-devel(x86_64)-2.3.4 passed
Result: Package existence check passed for "glibc-devel(x86_64)"
Check: Package existence for "glibc-headers"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
oracle02 glibc-headers-2.12-1.192.el6 glibc-headers-2.3.4 passed
oracle01 glibc-headers-2.12-1.192.el6 glibc-headers-2.3.4 passed
Result: Package existence check passed for "glibc-headers"
Check: Package existence for "gcc-c++(x86_64)"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
oracle02 gcc-c++(x86_64)-4.4.7-17.el6 gcc-c++(x86_64)-3.4.6 passed
oracle01 gcc-c++(x86_64)-4.4.7-17.el6 gcc-c++(x86_64)-3.4.6 passed
Result: Package existence check passed for "gcc-c++(x86_64)"
Check: Package existence for "libaio-devel(x86_64)"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
oracle02 libaio-devel(x86_64)-0.3.107-10.el6 libaio-devel(x86_64)-0.3.105 passed
oracle01 libaio-devel(x86_64)-0.3.107-10.el6 libaio-devel(x86_64)-0.3.105 passed
Result: Package existence check passed for "libaio-devel(x86_64)"
Check: Package existence for "libgcc(x86_64)"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
oracle02 libgcc(x86_64)-4.4.7-17.el6 libgcc(x86_64)-3.4.6 passed
oracle01 libgcc(x86_64)-4.4.7-17.el6 libgcc(x86_64)-3.4.6 passed
Result: Package existence check passed for "libgcc(x86_64)"
Check: Package existence for "libstdc++(x86_64)"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
oracle02 libstdc++(x86_64)-4.4.7-17.el6 libstdc++(x86_64)-3.4.6 passed
oracle01 libstdc++(x86_64)-4.4.7-17.el6 libstdc++(x86_64)-3.4.6 passed
Result: Package existence check passed for "libstdc++(x86_64)"
Check: Package existence for "libstdc++-devel(x86_64)"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
oracle02 libstdc++-devel(x86_64)-4.4.7-17.el6 libstdc++-devel(x86_64)-3.4.6 passed
oracle01 libstdc++-devel(x86_64)-4.4.7-17.el6 libstdc++-devel(x86_64)-3.4.6 passed
Result: Package existence check passed for "libstdc++-devel(x86_64)"
Check: Package existence for "sysstat"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
oracle02 sysstat-9.0.4-31.el6 sysstat-5.0.5 passed
oracle01 sysstat-9.0.4-31.el6 sysstat-5.0.5 passed
Result: Package existence check passed for "sysstat"
Check: Package existence for "pdksh"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
oracle02 missing pdksh-5.2.14 failed
oracle01 missing pdksh-5.2.14 failed
Result: Package existence check failed for "pdksh"
Check: Package existence for "expat(x86_64)"
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
oracle02 expat(x86_64)-2.0.1-11.el6_2 expat(x86_64)-1.95.7 passed
oracle01 expat(x86_64)-2.0.1-11.el6_2 expat(x86_64)-1.95.7 passed
Result: Package existence check passed for "expat(x86_64)"
Checking for multiple users with UID value 0
Result: Check for multiple users with UID value 0 passed
Check: Current group ID
Result: Current group ID check passed
Starting check for consistency of primary group of root user
Node Name Status
------------------------------------ ------------------------
oracle02 passed
oracle01 passed
Check for consistency of root user's primary group passed
Starting Clock synchronization checks using Network Time Protocol(NTP)...
NTP Configuration file check started...
The NTP configuration file "/etc/ntp.conf" is available on all nodes
NTP Configuration file check passed
Checking daemon liveness...
Check: Liveness for "ntpd"
Node Name Running?
------------------------------------ ------------------------
oracle02 yes
oracle01 yes
Result: Liveness check passed for "ntpd"
Check for NTP daemon or service alive passed on all nodes
Checking NTP daemon command line for slewing option "-x"
Check: NTP daemon command line
Node Name Slewing Option Set?
------------------------------------ ------------------------
oracle02 yes
oracle01 no
Result:
NTP daemon slewing option check failed on some nodes
PRVF-5436 : The NTP daemon running on one or more nodes lacks the slewing option "-x"
Result: Clock synchronization check using Network Time Protocol(NTP) failed
Checking Core file name pattern consistency...
Core file name pattern consistency check passed.
Checking to make sure user "grid" is not in "root" group
Node Name Status Comment
------------ ------------------------ ------------------------
oracle02 passed does not exist
oracle01 passed does not exist
Result: User "grid" is not part of "root" group. Check passed
Check default user file creation mask
Node Name Available Required Comment
------------ ------------------------ ------------------------ ----------
oracle02 0022 0022 passed
oracle01 0022 0022 passed
Result: Default user file creation mask check passed
Checking consistency of file "/etc/resolv.conf" across nodes
Checking the file "/etc/resolv.conf" to make sure only one of domain and search entries is defined
File "/etc/resolv.conf" does not have both domain and search entries defined
Checking if domain entry in file "/etc/resolv.conf" is consistent across the nodes...
domain entry in file "/etc/resolv.conf" is consistent across nodes
Checking if search entry in file "/etc/resolv.conf" is consistent across the nodes...
search entry in file "/etc/resolv.conf" is consistent across nodes
Checking DNS response time for an unreachable node
Node Name Status
------------------------------------ ------------------------
oracle02 failed
oracle01 failed
PRVF-5636 : The DNS response time for an unreachable node exceeded "15000" ms on following nodes: oracle02,oracle01
File "/etc/resolv.conf" is not consistent across nodes
Check: Time zone consistency
Result: Time zone consistency check passed
Pre-check for cluster services setup was unsuccessful on all the nodes.
3.2.2. 查看当前集群状态
[grid@oracle02 ~]$ crsctl stat res -t
--------------------------------------------------------------------------------
NAME TARGET STATE SERVER STATE_DETAILS
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.ARCH.dg
ONLINE ONLINE oracle02
ora.DATA.dg
ONLINE ONLINE oracle02
ora.LISTENER.lsnr
ONLINE ONLINE oracle02
ora.OCR_VOTE.dg
ONLINE ONLINE oracle02
ora.asm
ONLINE ONLINE oracle02 Started
ora.gsd
OFFLINE OFFLINE oracle02
ora.net1.network
ONLINE ONLINE oracle02
ora.ons
ONLINE ONLINE oracle02
ora.registry.acfs
ONLINE ONLINE oracle02
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
1 ONLINE ONLINE oracle02
ora.cvu
1 ONLINE ONLINE oracle02
ora.oc4j
1 ONLINE ONLINE oracle02
ora.oracle01.vip
1 ONLINE INTERMEDIATE oracle02 FAILED OVER
ora.oracle02.vip
1 ONLINE ONLINE oracle02
ora.scan1.vip
1 ONLINE ONLINE oracle02
ora.wlsi.db
1 ONLINE OFFLINE
2 ONLINE ONLINE oracle02 Open
3.2.3. 更新集群信息
[oracle@oracle02 bin]$ ./runInstaller -updateNodeList ORACLE_HOME=/oracle/app/product/11.2.0/db_1 "CLUSTER_NODES=oracle02"
Starting Oracle Universal Installer...
Checking swap space: must be greater than 500 MB. Actual 63999 MB Passed
The inventory pointer is located at /etc/oraInst.loc
The inventory is located at /oracle/oraInventory
'UpdateNodeList' was successful.
3.2.4. 停止和删除1节点vip监听
[root@oracle02 bin]# ./srvctl stop vip -i oracle01-vip
[root@oracle02 bin]# ./srvctl remove vip -i oracle01-vip -f
[root@oracle02 bin]# ./crsctl stat res -t
--------------------------------------------------------------------------------
NAME TARGET STATE SERVER STATE_DETAILS
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.ARCH.dg
ONLINE ONLINE oracle02
ora.DATA.dg
ONLINE ONLINE oracle02
ora.LISTENER.lsnr
ONLINE ONLINE oracle02
ora.OCR_VOTE.dg
ONLINE ONLINE oracle02
ora.asm
ONLINE ONLINE oracle02 Started
ora.gsd
OFFLINE OFFLINE oracle02
ora.net1.network
ONLINE ONLINE oracle02
ora.ons
ONLINE ONLINE oracle02
ora.registry.acfs
ONLINE ONLINE oracle02
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
1 ONLINE ONLINE oracle02
ora.cvu
1 ONLINE ONLINE oracle02
ora.oc4j
1 ONLINE ONLINE oracle02
ora.oracle02.vip
1 ONLINE ONLINE oracle02
ora.scan1.vip
1 ONLINE ONLINE oracle02
ora.wlsi.db
2 ONLINE ONLINE oracle02 Open
3.2.5. 剔除节点1
[root@oracle02 ~]# cd /oracle/grid/crs_1/bin/
You have new mail in /var/spool/mail/root
[root@oracle02 bin]# ./olsnodes -s -t
oracle01 Inactive Unpinned
oracle02 Active Unpinned
[root@oracle02 bin]# ./crsctl delete node -n oracle01
CRS-4661: Node oracle01 successfully deleted.
3.3. 安装数据库集群软件
在2节点上向1节点安装数据库集群软件。
[root@oracle02 bin]# su - grid
[grid@oracle02 ~]$ cd $ORACLE_HOME
[grid@oracle02 crs_1]$ cd oui
[grid@oracle02 oui]$ cd bin
[grid@oracle02 bin]$ ./runInstaller -updateNodeList ORACLE_HOME=/oracle/grid/crs_1 "CLUSTER_NODES=oracle02" CRS=TRUE -silent
Starting Oracle Universal Installer...
Checking swap space: must be greater than 500 MB. Actual 63999 MB Passed
The inventory pointer is located at /etc/oraInst.loc
The inventory is located at /oracle/oraInventory
'UpdateNodeList' was successful.
[root@oracle02 bin]# ./olsnodes
oracle02
[root@oracle02 bin]# pwd
/oracle/grid/crs_1/bin
[grid@oracle02 audit]$ cd $ORACLE_HOME
[grid@oracle02 crs_1]$ cd oui/bin/
[grid@oracle02 bin]$ export IGNORE_PREADDNODE_CHECKS=Y
[grid@oracle02 bin]$ ./addNode.sh "CLUSTER_NEW_NODES=oracle01" "CLUSTER_NEW_VIRTUAL_HOSTNAMES=oracle01-vip"
Starting Oracle Universal Installer...
Checking swap space: must be greater than 500 MB. Actual 63999 MB Passed
Oracle Universal Installer, Version 11.2.0.4.0 Production
Copyright (C) 1999, 2013, Oracle. All rights reserved.
SEVERE:Cannot perform add node procedure as the value of CLUSTER_NEW_VIRTUAL_HOSTNAMES or CLUSTER_NEW_NODES or both could not be obtained from the command line or response file(s). Silent install cannot continue.
[grid@oracle02 bin]$ ./addNode.sh -silent "CLUSTER_NEW_NODES={oracle01}" "CLUSTER_NEW_VIRTUAL_HOSTNAMES={oracle01-vip}"
Starting Oracle Universal Installer...
Checking swap space: must be greater than 500 MB. Actual 63999 MB Passed
Oracle Universal Installer, Version 11.2.0.4.0 Production
Copyright (C) 1999, 2013, Oracle. All rights reserved.
Performing tests to see whether nodes oracle01 are available
............................................................... 100% Done.
.
-----------------------------------------------------------------------------
Cluster Node Addition Summary
Global Settings
Source: /oracle/grid/crs_1
New Nodes
Space Requirements
New Nodes
oracle01
/oracle: Required 9.79GB : Available 63.69GB
Installed Products
Product Names
Oracle Grid Infrastructure 11g 11.2.0.4.0
Java Development Kit 1.5.0.51.10
Installer SDK Component 11.2.0.4.0
Oracle One-Off Patch Installer 11.2.0.3.4
Oracle Universal Installer 11.2.0.4.0
Oracle RAC Required Support Files-HAS 11.2.0.4.0
Oracle USM Deconfiguration 11.2.0.4.0
Oracle Configuration Manager Deconfiguration 10.3.1.0.0
Enterprise Manager Common Core Files 10.2.0.4.5
Oracle DBCA Deconfiguration 11.2.0.4.0
Oracle RAC Deconfiguration 11.2.0.4.0
Oracle Quality of Service Management (Server) 11.2.0.4.0
Installation Plugin Files 11.2.0.4.0
Universal Storage Manager Files 11.2.0.4.0
Oracle Text Required Support Files 11.2.0.4.0
Automatic Storage Management Assistant 11.2.0.4.0
Oracle Database 11g Multimedia Files 11.2.0.4.0
Oracle Multimedia Java Advanced Imaging 11.2.0.4.0
Oracle Globalization Support 11.2.0.4.0
Oracle Multimedia Locator RDBMS Files 11.2.0.4.0
Oracle Core Required Support Files 11.2.0.4.0
Bali Share 1.1.18.0.0
Oracle Database Deconfiguration 11.2.0.4.0
Oracle Quality of Service Management (Client) 11.2.0.4.0
Expat libraries 2.0.1.0.1
Oracle Containers for Java 11.2.0.4.0
Perl Modules 5.10.0.0.1
Secure Socket Layer 11.2.0.4.0
Oracle JDBC/OCI Instant Client 11.2.0.4.0
Oracle Multimedia Client Option 11.2.0.4.0
LDAP Required Support Files 11.2.0.4.0
Character Set Migration Utility 11.2.0.4.0
Perl Interpreter 5.10.0.0.2
PL/SQL Embedded Gateway 11.2.0.4.0
OLAP SQL Scripts 11.2.0.4.0
Database SQL Scripts 11.2.0.4.0
Oracle Extended Windowing Toolkit 3.4.47.0.0
SSL Required Support Files for InstantClient 11.2.0.4.0
SQL*Plus Files for Instant Client 11.2.0.4.0
Oracle Net Required Support Files 11.2.0.4.0
Oracle Database User Interface 2.2.13.0.0
RDBMS Required Support Files for Instant Client 11.2.0.4.0
RDBMS Required Support Files Runtime 11.2.0.4.0
XML Parser for Java 11.2.0.4.0
Oracle Security Developer Tools 11.2.0.4.0
Oracle Wallet Manager 11.2.0.4.0
Enterprise Manager plugin Common Files 11.2.0.4.0
Platform Required Support Files 11.2.0.4.0
Oracle JFC Extended Windowing Toolkit 4.2.36.0.0
RDBMS Required Support Files 11.2.0.4.0
Oracle Ice Browser 5.2.3.6.0
Oracle Help For Java 4.2.9.0.0
Enterprise Manager Common Files 10.2.0.4.5
Deinstallation Tool 11.2.0.4.0
Oracle Java Client 11.2.0.4.0
Cluster Verification Utility Files 11.2.0.4.0
Oracle Notification Service (eONS) 11.2.0.4.0
Oracle LDAP administration 11.2.0.4.0
Cluster Verification Utility Common Files 11.2.0.4.0
Oracle Clusterware RDBMS Files 11.2.0.4.0
Oracle Locale Builder 11.2.0.4.0
Oracle Globalization Support 11.2.0.4.0
Buildtools Common Files 11.2.0.4.0
HAS Common Files 11.2.0.4.0
SQL*Plus Required Support Files 11.2.0.4.0
XDK Required Support Files 11.2.0.4.0
Agent Required Support Files 10.2.0.4.5
Parser Generator Required Support Files 11.2.0.4.0
Precompiler Required Support Files 11.2.0.4.0
Installation Common Files 11.2.0.4.0
Required Support Files 11.2.0.4.0
Oracle JDBC/THIN Interfaces 11.2.0.4.0
Oracle Multimedia Locator 11.2.0.4.0
Oracle Multimedia 11.2.0.4.0
Assistant Common Files 11.2.0.4.0
Oracle Net 11.2.0.4.0
PL/SQL 11.2.0.4.0
HAS Files for DB 11.2.0.4.0
Oracle Recovery Manager 11.2.0.4.0
Oracle Database Utilities 11.2.0.4.0
Oracle Notification Service 11.2.0.3.0
SQL*Plus 11.2.0.4.0
Oracle Netca Client 11.2.0.4.0
Oracle Advanced Security 11.2.0.4.0
Oracle JVM 11.2.0.4.0
Oracle Internet Directory Client 11.2.0.4.0
Oracle Net Listener 11.2.0.4.0
Cluster Ready Services Files 11.2.0.4.0
Oracle Database 11g 11.2.0.4.0
-----------------------------------------------------------------------------
Instantiating scripts for add node (Wednesday, November 11, 2020 12:30:04 AM CST)
. 1% Done.
Instantiation of add node scripts complete
Copying to remote nodes (Wednesday, November 11, 2020 12:30:06 AM CST)
............................................................................................... 96% Done.
Home copied to new nodes
Saving inventory on nodes (Wednesday, November 11, 2020 12:33:12 AM CST)
. 100% Done.
Save inventory complete
WARNING:A new inventory has been created on one or more nodes in this session. However, it has not yet been registered as the central inventory of this system.
To register the new inventory please run the script at '/oracle/oraInventory/orainstRoot.sh' with root privileges on nodes 'oracle01'.
If you do not register the inventory, you may not be able to update or patch the products you installed.
The following configuration scripts need to be executed as the "root" user in each new cluster node. Each script in the list below is followed by a list of nodes.
/oracle/oraInventory/orainstRoot.sh #On nodes oracle01
/oracle/grid/crs_1/root.sh #On nodes oracle01
To execute the configuration scripts:
1. Open a terminal window
2. Log in as "root"
3. Run the scripts in each cluster node
The Cluster Node Addition of /oracle/grid/crs_1 was successful.
Please check '/tmp/silentInstall.log' for more details.
[root@oracle01 ~]# /oracle/oraInventory/orainstRoot.sh
Creating the Oracle inventory pointer file (/etc/oraInst.loc)
Changing permissions of /oracle/oraInventory.
Adding read,write permissions for group.
Removing read,write,execute permissions for world.
Changing groupname of /oracle/oraInventory to oinstall.
The execution of the script is complete.
[root@oracle01 ~]# /oracle/grid/crs_1/root.sh
Performing root user operation for Oracle 11g
The following environment variables are set as:
ORACLE_OWNER= grid
ORACLE_HOME= /oracle/grid/crs_1
Enter the full pathname of the local bin directory: [/usr/local/bin]:
Copying dbhome to /usr/local/bin ...
Copying oraenv to /usr/local/bin ...
Copying coraenv to /usr/local/bin ...
Creating /etc/oratab file...
Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.
Using configuration parameter file: /oracle/grid/crs_1/crs/install/crsconfig_params
Creating trace directory
User ignored Prerequisites during installation
Installing Trace File Analyzer
OLR initialization - successful
Adding Clusterware entries to oracle-ohasd.conf
CRS-2672: Attempting to start 'ora.mdnsd' on 'oracle01'
CRS-2676: Start of 'ora.mdnsd' on 'oracle01' succeeded
CRS-2672: Attempting to start 'ora.gpnpd' on 'oracle01'
CRS-2676: Start of 'ora.gpnpd' on 'oracle01' succeeded
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'oracle01'
CRS-2672: Attempting to start 'ora.gipcd' on 'oracle01'
CRS-2676: Start of 'ora.cssdmonitor' on 'oracle01' succeeded
CRS-2676: Start of 'ora.gipcd' on 'oracle01' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'oracle01'
CRS-2672: Attempting to start 'ora.diskmon' on 'oracle01'
CRS-2676: Start of 'ora.diskmon' on 'oracle01' succeeded
CRS-2676: Start of 'ora.cssd' on 'oracle01' succeeded
Start of resource "ora.cssd" failed
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'oracle01'
CRS-2672: Attempting to start 'ora.gipcd' on 'oracle01'
CRS-2676: Start of 'ora.cssdmonitor' on 'oracle01' succeeded
CRS-2676: Start of 'ora.gipcd' on 'oracle01' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'oracle01'
CRS-2672: Attempting to start 'ora.diskmon' on 'oracle01'
CRS-2676: Start of 'ora.diskmon' on 'oracle01' succeeded
CRS-2674: Start of 'ora.cssd' on 'oracle01' failed
CRS-2679: Attempting to clean 'ora.cssd' on 'oracle01'
CRS-2681: Clean of 'ora.cssd' on 'oracle01' succeeded
CRS-2673: Attempting to stop 'ora.gipcd' on 'oracle01'
CRS-2677: Stop of 'ora.gipcd' on 'oracle01' succeeded
CRS-2673: Attempting to stop 'ora.cssdmonitor' on 'oracle01'
CRS-2677: Stop of 'ora.cssdmonitor' on 'oracle01' succeeded
CRS-5804: Communication error with agent process
CRS-4000: Command Start failed, or completed with errors.
Failed to start Oracle Grid Infrastructure stack
Failed to start Cluster Synchorinisation Service in clustered mode at /oracle/grid/crs_1/crs/install/crsconfig_lib.pm line 1285.
/oracle/grid/crs_1/perl/bin/perl -I/oracle/grid/crs_1/perl/lib -I/oracle/grid/crs_1/crs/install /oracle/grid/crs_1/crs/install/rootcrs.pl execution failed
由于ASM磁盘组磁盘的多路径问题,导致root.sh脚本运行失败,后续通过停机重新配置磁盘多路径后,重新运行root.sh脚本完成。
3.4. 安装数据库软件
[oracle@oracle02 ~]$ cd /oracle/app/product/11.2.0/db_1/oui/bin/
[oracle@oracle02 bin]$ export IGNORE_PREADDNODE_CHECKS=Y
[oracle@oracle02 bin]$ ./addNode.sh -silent "CLUSTER_NEW_NODES=oracle01"
Starting Oracle Universal Installer...
Checking swap space: must be greater than 500 MB. Actual 63999 MB Passed
Oracle Universal Installer, Version 11.2.0.4.0 Production
Copyright (C) 1999, 2013, Oracle. All rights reserved.
SEVERE:Values for the following variables could not be obtained from the command line or response file(s):
CLUSTER_NEW_NODES(NewNodes)
Silent install cannot continue.
[oracle@oracle02 bin]$ cd $ORACLE_HOME/oui/bin
[oracle@oracle02 bin]$ export IGNORE_PREADDNODE_CHECKS=Y
[oracle@oracle02 bin]$ ./addNode.sh -silent "CLUSTER_NEW_NODES={oracle01}"
Starting Oracle Universal Installer...
Checking swap space: must be greater than 500 MB. Actual 63999 MB Passed
Oracle Universal Installer, Version 11.2.0.4.0 Production
Copyright (C) 1999, 2013, Oracle. All rights reserved.
Performing tests to see whether nodes oracle01 are available
............................................................... 100% Done.
.
-----------------------------------------------------------------------------
Cluster Node Addition Summary
Global Settings
Source: /oracle/app/product/11.2.0/db_1
New Nodes
Space Requirements
New Nodes
oracle01
/oracle: Required 5.13GB : Available 57.03GB
Installed Products
Product Names
Oracle Database 11g 11.2.0.4.0
Java Development Kit 1.5.0.51.10
Installer SDK Component 11.2.0.4.0
Oracle One-Off Patch Installer 11.2.0.3.4
Oracle Universal Installer 11.2.0.4.0
Oracle USM Deconfiguration 11.2.0.4.0
Oracle Configuration Manager Deconfiguration 10.3.1.0.0
Oracle DBCA Deconfiguration 11.2.0.4.0
Oracle RAC Deconfiguration 11.2.0.4.0
Oracle Database Deconfiguration 11.2.0.4.0
Oracle Configuration Manager Client 10.3.2.1.0
Oracle Configuration Manager 10.3.8.1.0
Oracle ODBC Driverfor Instant Client 11.2.0.4.0
LDAP Required Support Files 11.2.0.4.0
SSL Required Support Files for InstantClient 11.2.0.4.0
Bali Share 1.1.18.0.0
Oracle Extended Windowing Toolkit 3.4.47.0.0
Oracle JFC Extended Windowing Toolkit 4.2.36.0.0
Oracle Real Application Testing 11.2.0.4.0
Oracle Database Vault J2EE Application 11.2.0.4.0
Oracle Label Security 11.2.0.4.0
Oracle Data Mining RDBMS Files 11.2.0.4.0
Oracle OLAP RDBMS Files 11.2.0.4.0
Oracle OLAP API 11.2.0.4.0
Platform Required Support Files 11.2.0.4.0
Oracle Database Vault option 11.2.0.4.0
Oracle RAC Required Support Files-HAS 11.2.0.4.0
SQL*Plus Required Support Files 11.2.0.4.0
Oracle Display Fonts 9.0.2.0.0
Oracle Ice Browser 5.2.3.6.0
Oracle JDBC Server Support Package 11.2.0.4.0
Oracle SQL Developer 11.2.0.4.0
Oracle Application Express 11.2.0.4.0
XDK Required Support Files 11.2.0.4.0
RDBMS Required Support Files for Instant Client 11.2.0.4.0
SQLJ Runtime 11.2.0.4.0
Database Workspace Manager 11.2.0.4.0
RDBMS Required Support Files Runtime 11.2.0.4.0
Oracle Globalization Support 11.2.0.4.0
Exadata Storage Server 11.2.0.1.0
Provisioning Advisor Framework 10.2.0.4.3
Enterprise Manager Database Plugin -- Repository Support 11.2.0.4.0
Enterprise Manager Repository Core Files 10.2.0.4.5
Enterprise Manager Database Plugin -- Agent Support 11.2.0.4.0
Enterprise Manager Grid Control Core Files 10.2.0.4.5
Enterprise Manager Common Core Files 10.2.0.4.5
Enterprise Manager Agent Core Files 10.2.0.4.5
RDBMS Required Support Files 11.2.0.4.0
regexp 2.1.9.0.0
Agent Required Support Files 10.2.0.4.5
Oracle 11g Warehouse Builder Required Files 11.2.0.4.0
Oracle Notification Service (eONS) 11.2.0.4.0
Oracle Text Required Support Files 11.2.0.4.0
Parser Generator Required Support Files 11.2.0.4.0
Oracle Database 11g Multimedia Files 11.2.0.4.0
Oracle Multimedia Java Advanced Imaging 11.2.0.4.0
Oracle Multimedia Annotator 11.2.0.4.0
Oracle JDBC/OCI Instant Client 11.2.0.4.0
Oracle Multimedia Locator RDBMS Files 11.2.0.4.0
Precompiler Required Support Files 11.2.0.4.0
Oracle Core Required Support Files 11.2.0.4.0
Sample Schema Data 11.2.0.4.0
Oracle Starter Database 11.2.0.4.0
Oracle Message Gateway Common Files 11.2.0.4.0
Oracle XML Query 11.2.0.4.0
XML Parser for Oracle JVM 11.2.0.4.0
Oracle Help For Java 4.2.9.0.0
Installation Plugin Files 11.2.0.4.0
Enterprise Manager Common Files 10.2.0.4.5
Expat libraries 2.0.1.0.1
Deinstallation Tool 11.2.0.4.0
Oracle Quality of Service Management (Client) 11.2.0.4.0
Perl Modules 5.10.0.0.1
JAccelerator (COMPANION) 11.2.0.4.0
Oracle Containers for Java 11.2.0.4.0
Perl Interpreter 5.10.0.0.2
Oracle Net Required Support Files 11.2.0.4.0
Secure Socket Layer 11.2.0.4.0
Oracle Universal Connection Pool 11.2.0.4.0
Oracle JDBC/THIN Interfaces 11.2.0.4.0
Oracle Multimedia Client Option 11.2.0.4.0
Oracle Java Client 11.2.0.4.0
Character Set Migration Utility 11.2.0.4.0
Oracle Code Editor 1.2.1.0.0I
PL/SQL Embedded Gateway 11.2.0.4.0
OLAP SQL Scripts 11.2.0.4.0
Database SQL Scripts 11.2.0.4.0
Oracle Locale Builder 11.2.0.4.0
Oracle Globalization Support 11.2.0.4.0
SQL*Plus Files for Instant Client 11.2.0.4.0
Required Support Files 11.2.0.4.0
Oracle Database User Interface 2.2.13.0.0
Oracle ODBC Driver 11.2.0.4.0
Oracle Notification Service 11.2.0.3.0
XML Parser for Java 11.2.0.4.0
Oracle Security Developer Tools 11.2.0.4.0
Oracle Wallet Manager 11.2.0.4.0
Cluster Verification Utility Common Files 11.2.0.4.0
Oracle Clusterware RDBMS Files 11.2.0.4.0
Oracle UIX 2.2.24.6.0
Enterprise Manager plugin Common Files 11.2.0.4.0
HAS Common Files 11.2.0.4.0
Precompiler Common Files 11.2.0.4.0
Installation Common Files 11.2.0.4.0
Oracle Help for the Web 2.0.14.0.0
Oracle LDAP administration 11.2.0.4.0
Buildtools Common Files 11.2.0.4.0
Assistant Common Files 11.2.0.4.0
Oracle Recovery Manager 11.2.0.4.0
PL/SQL 11.2.0.4.0
Generic Connectivity Common Files 11.2.0.4.0
Oracle Database Gateway for ODBC 11.2.0.4.0
Oracle Programmer 11.2.0.4.0
Oracle Database Utilities 11.2.0.4.0
Enterprise Manager Agent 10.2.0.4.5
SQL*Plus 11.2.0.4.0
Oracle Netca Client 11.2.0.4.0
Oracle Multimedia Locator 11.2.0.4.0
Oracle Call Interface (OCI) 11.2.0.4.0
Oracle Multimedia 11.2.0.4.0
Oracle Net 11.2.0.4.0
Oracle XML Development Kit 11.2.0.4.0
Oracle Internet Directory Client 11.2.0.4.0
Database Configuration and Upgrade Assistants 11.2.0.4.0
Oracle JVM 11.2.0.4.0
Oracle Advanced Security 11.2.0.4.0
Oracle Net Listener 11.2.0.4.0
Oracle Enterprise Manager Console DB 11.2.0.4.0
HAS Files for DB 11.2.0.4.0
Oracle Text 11.2.0.4.0
Oracle Net Services 11.2.0.4.0
Oracle Database 11g 11.2.0.4.0
Oracle OLAP 11.2.0.4.0
Oracle Spatial 11.2.0.4.0
Oracle Partitioning 11.2.0.4.0
Enterprise Edition Options 11.2.0.4.0
-----------------------------------------------------------------------------
Instantiating scripts for add node (Wednesday, November 11, 2020 12:17:24 PM CST)
. 1% Done.
Instantiation of add node scripts complete
Copying to remote nodes (Wednesday, November 11, 2020 12:17:26 PM CST)
............................................................................................... 96% Done.
Home copied to new nodes
Saving inventory on nodes (Wednesday, November 11, 2020 12:21:20 PM CST)
. 100% Done.
Save inventory complete
WARNING:
The following configuration scripts need to be executed as the "root" user in each new cluster node. Each script in the list below is followed by a list of nodes.
/oracle/app/product/11.2.0/db_1/root.sh #On nodes oracle01
To execute the configuration scripts:
1. Open a terminal window
2. Log in as "root"
3. Run the scripts in each cluster node
The Cluster Node Addition of /oracle/app/product/11.2.0/db_1 was successful.
Please check '/tmp/silentInstall.log' for more details.
[root@oracle01 rules.d]# /oracle/app/product/11.2.0/db_1/root.sh
Performing root user operation for Oracle 11g
The following environment variables are set as:
ORACLE_OWNER= oracle
ORACLE_HOME= /oracle/app/product/11.2.0/db_1
Enter the full pathname of the local bin directory: [/usr/local/bin]:
Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.
Finished product-specific root actions.
[root@oracle02 rules.d]# crsctl status res -t
--------------------------------------------------------------------------------
NAME TARGET STATE SERVER STATE_DETAILS
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.ARCH.dg
ONLINE ONLINE oracle01
ONLINE ONLINE oracle02
ora.DATA.dg
ONLINE ONLINE oracle01
ONLINE ONLINE oracle02
ora.LISTENER.lsnr
ONLINE ONLINE oracle01
ONLINE ONLINE oracle02
ora.OCR_VOTE.dg
ONLINE ONLINE oracle01
ONLINE ONLINE oracle02
ora.asm
ONLINE ONLINE oracle01 Started
ONLINE ONLINE oracle02 Started
ora.gsd
OFFLINE OFFLINE oracle01
OFFLINE OFFLINE oracle02
ora.net1.network
ONLINE ONLINE oracle01
ONLINE ONLINE oracle02
ora.ons
ONLINE ONLINE oracle01
ONLINE ONLINE oracle02
ora.registry.acfs
ONLINE ONLINE oracle01
ONLINE ONLINE oracle02
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
1 ONLINE ONLINE oracle02
ora.cvu
1 ONLINE ONLINE oracle02
ora.oc4j
1 ONLINE ONLINE oracle02
ora.oracle01.vip
1 ONLINE ONLINE oracle01
ora.oracle02.vip
1 ONLINE ONLINE oracle02
ora.scan1.vip
1 ONLINE ONLINE oracle02
ora.orcl.db
2 ONLINE ONLINE oracle02 Open
3.5. 添加节点1至集群
[oracle@oracle02 ~]$ srvctl status database -d orcl
Instanceorcl2 is running on node oracle02
[oracle@oracle02 ~]$ srvctl add instance -dorcl -i orcl1 -n oracle01
[oracle@oracle02 ~]$ srvctl status database -d orcl
Instance orcl1 is not running on node oracle01
Instanceorcl2 is running on node oracle02
[oracle@oracle02 ~]$ srvctl stop instance -d orcl -i orcl1
[oracle@oracle02 ~]$ srvctl start instance -d orcl -i orcl1
[oracle@oracle02 ~]$ sqlplus / as sysdba
SQL*Plus: Release 11.2.0.4.0 Production on Wed Nov 11 12:28:43 2020
Copyright (c) 1982, 2013, Oracle. All rights reserved.
Connected to:
Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 - 64bit Production
With the Partitioning, Real Application Clusters, Automatic Storage Management, OLAP,
Data Mining and Real Application Testing options
SQL> select thread#,inst_id,instance_number,instance_name,host_name,status,startup_time from gv$instance;
THREAD# INST_ID INSTANCE_NUMBER INSTANCE_NAME HOST_NAME STATUS STARTUP_T
---------- ---------- --------------- ---------------- --------------- ------------ ---------
2 2 2 orcl2 oracle02 OPEN 26-OCT-19
1 1 1 orcl1 oracle01 OPEN 11-NOV-20