1.升级grid
当前rac状态:
[root@rac1 ~]# crs_stat -t
NameTypeTargetStateHost
------------------------------------------------------------
ora.rac.db application ONLINE ONLINE rac1
ora....c1.inst application ONLINE ONLINE rac1
ora....c2.inst application ONLINE ONLINE rac2
ora....SM1.asm application ONLINE ONLINE rac1
ora....C1.lsnr application ONLINE ONLINE rac1
ora.rac1.gsd application ONLINE ONLINE rac1
ora.rac1.ons application ONLINE ONLINE rac1
ora.rac1.vip application ONLINE ONLINE rac1
ora....SM2.asm application ONLINE ONLINE rac2
ora....C2.lsnr application ONLINE ONLINE rac2
ora.rac2.gsd application ONLINE ONLINE rac2
ora.rac2.ons application ONLINE ONLINE rac2
ora.rac2.vip application ONLINE ONLINE rac2
crs版本:
[root@rac1 ~]# crsctl query crs softwareversion
CRS software version on node [rac1] is [10.2.0.5.0]
数据库版本:
[oracle@rac1 ~]$ sqlplus / as sysdba
SQL*Plus:Release10.2.0.5.0-Production on TueNov2219:07:552016
Copyright(c)1982,2010,Oracle.AllRightsReserved.
Connected to:
OracleDatabase10gEnterpriseEditionRelease10.2.0.5.0-64bitProduction
With the Partitioning,RealApplicationClusters, OLAP,DataMining
and RealApplicationTesting options
SQL> select * from v$version;
BANNER
----------------------------------------------------------------
OracleDatabase10gEnterpriseEditionRelease10.2.0.5.0-64bi
PL/SQL Release10.2.0.5.0-Production
CORE 10.2.0.5.0Production
TNS forLinux:Version10.2.0.5.0-Production
NLSRTL Version10.2.0.5.0–Production
Ocr检查:
[oracle@rac1 ~]$ ocrcheck
Status of OracleClusterRegistry is as follows :
Version:2
Total space (kbytes):1043916
Used space (kbytes):3848
Available space (kbytes):1040068
ID :1371096888
Device/FileName:/dev/raw/raw1
Device/File integrity check succeeded
Device/File not configured
Cluster registry integrity check succeeded
表决盘检查:
[oracle@rac1 ~]$ crsctl query css votedisk
0.0/dev/raw/raw2
located 1 votedisk(s).
检查软件包安装
检查/etc/security/limit.conf
检查/etc/sysctl.conf
在hosts中添加scan ip信息:
[root@rac1 ~]# cat /etc/hosts
#Do not remove the following line, or various programs
# that require network functionality will fail.
127.0.0.1 localhost.localdomain localhost
::1 localhost6.localdomain6 localhost6
192.168.56.110 rac1
192.168.56.111 rac2
192.168.56.112 rac1-vip
192.168.56.113 rac2-vip
172.16.8.1 rac1-priv
172.16.8.2 rac2-priv
192.168.56.115 rac-scan
查看oracle用户信息:
[oracle@rac1 ~]$ id oracle
uid=500(oracle) gid=500(oinstall) groups=500(oinstall),501(dba)
在所有节点修改oracle用户组添加asmadmin,asmdba,asmoper,oper组
groupadd -g 1020 asmadmin
groupadd -g 1021 asmdba
groupadd -g 1022 asmoper
groupadd -g 1032 oper
usermod -g oinstall -G dba,oper,asmadmin,asmdba,asmoper oracle
[root@rac1 ~]# id oracle
uid=500(oracle) gid=500(oinstall) groups=500(oinstall),501(dba),1020(asmadmin),1021(asmdba),1022(asmoper),1032(oper)
在所有节点创建11g安装文件目录
mkdir -p /u01/11.2.0/grid
chown -R oracle:oinstall /u01/11.2.0/grid
chmod -R 775/u01/11.2.0/grid
mkdir -p /u01/app/oracle/product/11.2.0/db_1
chown -R oracle:oinstall /u01/app/oracle/product/11.2.0/db_1
chmod -R 775/u01/app/oracle/product/11.2.0/db_1
在所有节点添加oracle和grid的环境变量:
vi ~/.bash_profile
添加以下的别名:
alias ora="export ORACLE_HOME=/u01/app/oracle/product/11.2.0/db_1
export PATH=/u01/app/oracle/product/11.2.0/db_1/bin:$CRS_HOME/bin:$PATH:$HOME/bin
export ORACLE_SID=rac1"
alias grid="export ORACLE_HOME=/u01/11.2.0/grid
export PATH=/u01/11.2.0/grid/bin:$CRS_HOME/bin:$PATH:$HOME/bin
export ORACLE_SID=+ASM1"
安装cvudisk包,用来检测oracle环境
[root@rac1 ~]# cd /home/oracle/grid/rpm/
[root@rac1 rpm]# ls
cvuqdisk-1.0.9-1.rpm
[root@rac1 rpm]# rpm -ivh cvuqdisk-1.0.9-1.rpm
Preparing...###########################################[100%]
1:cvuqdisk ###########################################[100%]
[oracle@rac1 grid]$ pwd
/home/oracle/grid
./runcluvfy.sh stage -pre crsinst -upgrade -n rac1,rac2 -rolling -src_crshome /u01/app/oracle/product/10.2.0/crs -dest_crshome /u01/11.2.0/grid -dest_version 11.2.0.4.0-fixup -fixupdir /home/oracle/fixupscript –verbose
[oracle@rac1 grid]$ ./runcluvfy.sh stage -pre crsinst -upgrade -n rac1,rac2 -rolling -src_crshome /u01/app/oracle/product/10.2.0/crs -dest_crshome /u01/11.2.0/grid -dest_version 11.2.0.4.0-fixup -fixupdir /home/oracle/fixupscript -verbose
Performing pre-checks for cluster services setup
Checking node reachability...
Check:Node reachability from node "rac1"
DestinationNodeReachable?
------------------------------------------------------------
rac2 yes
rac1 yes
Result:Node reachability check passed from node "rac1"
Checking user equivalence...
Check:User equivalence for user "oracle"
NodeNameStatus
------------------------------------------------------------
rac2 passed
rac1 passed
Result:User equivalence check passed for user "oracle"
Checking CRS user consistency
Result: CRS user consistency check successful
Checking node connectivity...
Checking hosts config file...
NodeNameStatus
------------------------------------------------------------
rac2 passed
rac1 passed
Verification of the hosts config file successful
Interface information for node "rac2"
Name IP AddressSubnetGatewayDef.Gateway HW Address MTU
-----------------------------------------------------------------------------------------
eth0 192.168.56.110192.168.56.00.0.0.0192.168.56.108:00:27:C7:64:121500
eth1 172.16.8.1172.16.8.00.0.0.0192.168.56.108:00:27:BE:FE:151500
Interface information for node "rac1"
Name IP AddressSubnetGatewayDef.Gateway HW Address MTU
-----------------------------------------------------------------------------------------
eth0 192.168.56.110192.168.56.00.0.0.0192.168.56.108:00:27:C7:64:121500
eth1 172.16.8.1172.16.8.00.0.0.0192.168.56.108:00:27:BE:FE:151500
Check:Node connectivity for interface "eth0"
SourceDestinationConnected?
----------------------------------------------------------------------------
rac2[192.168.56.110] rac1[192.168.56.110] yes
Result:Node connectivity passed for interface "eth0"
Check: TCP connectivity of subnet "192.168.56.0"
SourceDestinationConnected?
----------------------------------------------------------------------------
rac1:192.168.56.110 rac2:192.168.56.110 passed
Result: TCP connectivity check passed for subnet "192.168.56.0"
Check:Node connectivity for interface "eth1"
SourceDestinationConnected?
----------------------------------------------------------------------------
rac2[172.16.8.1] rac1[172.16.8.1] yes
Result:Node connectivity passed for interface "eth1"
Check: TCP connectivity of subnet "172.16.8.0"
SourceDestinationConnected?
----------------------------------------------------------------------------
rac1:172.16.8.1 rac2:172.16.8.1 passed
Result: TCP connectivity check passed for subnet "172.16.8.0"
Checking subnet mask consistency...
Subnet mask consistency check passed for subnet "192.168.56.0".
Subnet mask consistency check passed for subnet "172.16.8.0".
Subnet mask consistency check passed.
Result:Node connectivity check passed
Checking multicast communication...
Checking subnet "192.168.56.0"for multicast communication with multicast group "230.0.1.0"...
Check of subnet "192.168.56.0"for multicast communication with multicast group "230.0.1.0" passed.
Checking subnet "172.16.8.0"for multicast communication with multicast group "230.0.1.0"...
Check of subnet "172.16.8.0"for multicast communication with multicast group "230.0.1.0" passed.
Check of multicast communication passed.
Checking OCR integrity...
Checkfor compatible storage device for OCR location "/dev/raw/raw1"...
Checking OCR device "/dev/raw/raw1"for sharedness...
OCR device "/dev/raw/raw1" is shared...
Checking size of the OCR location "/dev/raw/raw1"...
Size check for OCR location "/dev/raw/raw1" successful...
OCR integrity check passed
CheckingASMLib configuration.
NodeNameStatus
------------------------------------------------------------
rac2 passed
rac1 passed
Result:CheckforASMLib configuration passed.
Check:Total memory
NodeNameAvailableRequiredStatus
----------------------------------------------------------------------
rac2 1.4264GB(1495664.0KB)1.5GB(1572864.0KB) failed
rac1 1.4264GB(1495664.0KB)1.5GB(1572864.0KB) failed
Result:Total memory check failed
Check:Available memory
NodeNameAvailableRequiredStatus
----------------------------------------------------------------------
rac2 785.3516MB(804200.0KB)50MB(51200.0KB) passed
rac1 785.3516MB(804200.0KB)50MB(51200.0KB) passed
Result:Available memory check passed
Check:Swap space
NodeNameAvailableRequiredStatus
----------------------------------------------------------------------
rac2 2.875GB(3014648.0KB)1.5GB(1572864.0KB) passed
rac1 2.875GB(3014648.0KB)1.5GB(1572864.0KB) passed
Result:Swap space check passed
Check:Free disk space for"rac2:/u01/11.2.0/grid,rac2:/tmp"
PathNodeNameMount point AvailableRequiredStatus
----------------------------------------------------------------------------
/u01/11.2.0/grid rac2 UNKNOWN NOTAVAIL 7.5GB failed
/tmp rac2 UNKNOWN NOTAVAIL 7.5GB failed
Result:Free disk space check failed for"rac2:/u01/11.2.0/grid,rac2:/tmp"
Check:Free disk space for"rac1:/u01/11.2.0/grid,rac1:/tmp"
PathNodeNameMount point AvailableRequiredStatus
----------------------------------------------------------------------------
/u01/11.2.0/grid rac1 /10.1629GB7.5GB passed
/tmp rac1 /10.1629GB7.5GB passed
Result:Free disk space check passed for"rac1:/u01/11.2.0/grid,rac1:/tmp"
Check:User existence for"oracle"
NodeNameStatusComment
------------------------------------------------------------
rac2 passed exists(500)
rac1 passed exists(500)
Checkingfor multiple users with UID value 500
Result:Checkfor multiple users with UID value 500 passed
Result:User existence check passed for"oracle"
Check:Group existence for"oinstall"
NodeNameStatusComment
------------------------------------------------------------
rac2 passed exists
rac1 passed exists
Result:Group existence check passed for"oinstall"
Check:Membership of user "oracle" in group "oinstall"[as Primary]
NodeNameUserExistsGroupExistsUser in GroupPrimaryStatus
----------------------------------------------------------------------------
rac2 yes yes yes yes passed
rac1 yes yes yes yes passed
Result:Membership check for user "oracle" in group "oinstall"[as Primary] passed
Check:Run level
NodeName run level RequiredStatus
----------------------------------------------------------------------
rac2 33,5 passed
rac1 33,5 passed
Result:Run level check passed
Check:Hard limits for"maximum open file descriptors"
NodeNameTypeAvailableRequiredStatus
--------------------------------------------------------------------
rac2 hard 6553665536 passed
rac1 hard 6553665536 passed
Result:Hard limits check passed for"maximum open file descriptors"
Check:Soft limits for"maximum open file descriptors"
NodeNameTypeAvailableRequiredStatus
--------------------------------------------------------------------
rac2 soft 10241024 passed
rac1 soft 10241024 passed
Result:Soft limits check passed for"maximum open file descriptors"
Check:Hard limits for"maximum user processes"
NodeNameTypeAvailableRequiredStatus
--------------------------------------------------------------------
rac2 hard 1638416384 passed
rac1 hard 1638416384 passed
Result:Hard limits check passed for"maximum user processes"
Check:Soft limits for"maximum user processes"
NodeNameTypeAvailableRequiredStatus
--------------------------------------------------------------------
rac2 soft 163842047 passed
rac1 soft 163842047 passed
Result:Soft limits check passed for"maximum user processes"
CheckingforOracle patch "14617909" in home "/u01/app/oracle/product/10.2.0/crs".
NodeNameAppliedRequiredComment
----------------------------------------------------------------------
rac2 missing 14617909 failed
rac1 missing 14617909 failed
Result:CheckforOracle patch "14617909" in home "/u01/app/oracle/product/10.2.0/crs" failed
There are no oracle patches required for home "/u01/11.2.0/grid".
Check:System architecture
NodeNameAvailableRequiredStatus
----------------------------------------------------------------------
rac2 x86_64 x86_64 passed
rac1 x86_64 x86_64 passed
Result:System architecture check passed
Check:Kernel version
NodeNameAvailableRequiredStatus
----------------------------------------------------------------------
rac2 2.6.32-200.13.1.el5uek2.6.18 passed
rac1 2.6.32-200.13.1.el5uek2.6.18 passed
Result:Kernel version check passed
Check:Kernel parameter for"semmsl"
NodeNameCurrentConfiguredRequiredStatusComment
----------------------------------------------------------------------------
rac2 250250250 passed
rac1 250250250 passed
Result:Kernel parameter check passed for"semmsl"
Check:Kernel parameter for"semmns"
NodeNameCurrentConfiguredRequiredStatusComment
----------------------------------------------------------------------------
rac2 320003200032000 passed
rac1 320003200032000 passed
Result:Kernel parameter check passed for"semmns"
Check:Kernel parameter for"semopm"
NodeNameCurrentConfiguredRequiredStatusComment
----------------------------------------------------------------------------
rac2 100100100 passed
rac1 100100100 passed
Result:Kernel parameter check passed for"semopm"
Check:Kernel parameter for"semmni"
NodeNameCurrentConfiguredRequiredStatusComment
----------------------------------------------------------------------------
rac2 128128128 passed
rac1 128128128 passed
Result:Kernel parameter check passed for"semmni"
Check:Kernel parameter for"shmmax"
NodeNameCurrentConfiguredRequiredStatusComment
----------------------------------------------------------------------------
rac2 43980465111044398046511104765779968 passed
rac1 43980465111044398046511104765779968 passed
Result:Kernel parameter check passed for"shmmax"
Check:Kernel parameter for"shmmni"
NodeNameCurrentConfiguredRequiredStatusComment
----------------------------------------------------------------------------
rac2 409640964096 passed
rac1 409640964096 passed
Result:Kernel parameter check passed for"shmmni"
Check:Kernel parameter for"shmall"
NodeNameCurrentConfiguredRequiredStatusComment
----------------------------------------------------------------------------
rac2 429496729642949672962097152 passed
rac1 429496729642949672962097152 passed
Result:Kernel parameter check passed for"shmall"
Check:Kernel parameter for"file-max"
NodeNameCurrentConfiguredRequiredStatusComment
----------------------------------------------------------------------------
rac2 681574468157446815744 passed
rac1 681574468157446815744 passed
Result:Kernel parameter check passed for"file-max"
Check:Kernel parameter for"ip_local_port_range"
NodeNameCurrentConfiguredRequiredStatusComment
----------------------------------------------------------------------------
rac2 between 9000.0&65500.0 between 9000.0&65500.0 between 9000.0&65500.0 passed
rac1 between 9000.0&65500.0 between 9000.0&65500.0 between 9000.0&65500.0 passed
Result:Kernel parameter check passed for"ip_local_port_range"
Check:Kernel parameter for"rmem_default"
NodeNameCurrentConfiguredRequiredStatusComment
----------------------------------------------------------------------------
rac2 10485761048576262144 passed
rac1 10485761048576262144 passed
Result:Kernel parameter check passed for"rmem_default"
Check:Kernel parameter for"rmem_max"
NodeNameCurrentConfiguredRequiredStatusComment
----------------------------------------------------------------------------
rac2 419430441943044194304 passed
rac1 419430441943044194304 passed
Result:Kernel parameter check passed for"rmem_max"
Check:Kernel parameter for"wmem_default"
NodeNameCurrentConfiguredRequiredStatusComment
----------------------------------------------------------------------------
rac2 262144262144262144 passed
rac1 262144262144262144 passed
Result:Kernel parameter check passed for"wmem_default"
Check:Kernel parameter for"wmem_max"
NodeNameCurrentConfiguredRequiredStatusComment
----------------------------------------------------------------------------
rac2 104857610485761048576 passed
rac1 104857610485761048576 passed
Result:Kernel parameter check passed for"wmem_max"
Check:Kernel parameter for"aio-max-nr"
NodeNameCurrentConfiguredRequiredStatusComment
----------------------------------------------------------------------------
rac2 104857610485761048576 passed
rac1 104857610485761048576 passed
Result:Kernel parameter check passed for"aio-max-nr"
Check:Package existence for"make"
NodeNameAvailableRequiredStatus
----------------------------------------------------------------------
rac2 make-3.81-3.el5 make-3.81 passed
rac1 make-3.81-3.el5 make-3.81 passed
Result:Package existence check passed for"make"
Check:Package existence for"binutils"
NodeNameAvailableRequiredStatus
----------------------------------------------------------------------
rac2 binutils-2.17.50.0.6-14.el5 binutils-2.17.50.0.6 passed
rac1 binutils-2.17.50.0.6-14.el5 binutils-2.17.50.0.6 passed
Result:Package existence check passed for"binutils"
Check:Package existence for"gcc(x86_64)"
NodeNameAvailableRequiredStatus
----------------------------------------------------------------------
rac2 gcc(x86_64)-4.1.2-51.el5 gcc(x86_64)-4.1.2 passed
rac1 gcc(x86_64)-4.1.2-51.el5 gcc(x86_64)-4.1.2 passed
Result:Package existence check passed for"gcc(x86_64)"
Check:Package existence for"libaio(x86_64)"
NodeNameAvailableRequiredStatus
----------------------------------------------------------------------
rac2 libaio(x86_64)-0.3.106-5 libaio(x86_64)-0.3.106 passed
rac1 libaio(x86_64)-0.3.106-5 libaio(x86_64)-0.3.106 passed
Result:Package existence check passed for"libaio(x86_64)"
Check:Package existence for"glibc(x86_64)"
NodeNameAvailableRequiredStatus
----------------------------------------------------------------------
rac2 glibc(x86_64)-2.5-65 glibc(x86_64)-2.5-24 passed
rac1 glibc(x86_64)-2.5-65 glibc(x86_64)-2.5-24 passed
Result:Package existence check passed for"glibc(x86_64)"
Check:Package existence for"compat-libstdc++-33(x86_64)"
NodeNameAvailableRequiredStatus
----------------------------------------------------------------------
rac2 compat-libstdc++-33(x86_64)-3.2.3-61 compat-libstdc++-33(x86_64)-3.2.3 passed
rac1 compat-libstdc++-33(x86_64)-3.2.3-61 compat-libstdc++-33(x86_64)-3.2.3 passed
Result:Package existence check passed for"compat-libstdc++-33(x86_64)"
Check:Package existence for"elfutils-libelf(x86_64)"
NodeNameAvailableRequiredStatus
----------------------------------------------------------------------
rac2 elfutils-libelf(x86_64)-0.137-3.el5 elfutils-libelf(x86_64)-0.125 passed
rac1 elfutils-libelf(x86_64)-0.137-3.el5 elfutils-libelf(x86_64)-0.125 passed
Result:Package existence check passed for"elfutils-libelf(x86_64)"
Check:Package existence for"elfutils-libelf-devel"
NodeNameAvailableRequiredStatus
----------------------------------------------------------------------
rac2 elfutils-libelf-devel-0.137-3.el5 elfutils-libelf-devel-0.125 passed
rac1 elfutils-libelf-devel-0.137-3.el5 elfutils-libelf-devel-0.125 passed
Result:Package existence check passed for"elfutils-libelf-devel"
Check:Package existence for"glibc-common"
NodeNameAvailableRequiredStatus
----------------------------------------------------------------------
rac2 glibc-common-2.5-65 glibc-common-2.5 passed
rac1 glibc-common-2.5-65 glibc-common-2.5 passed
Result:Package existence check passed for"glibc-common"
Check:Package existence for"glibc-devel(x86_64)"
NodeNameAvailableRequiredStatus
----------------------------------------------------------------------
rac2 glibc-devel(x86_64)-2.5-65 glibc-devel(x86_64)-2.5 passed
rac1 glibc-devel(x86_64)-2.5-65 glibc-devel(x86_64)-2.5 passed
Result:Package existence check passed for"glibc-devel(x86_64)"
Check:Package existence for"glibc-headers"
NodeNameAvailableRequiredStatus
----------------------------------------------------------------------
rac2 glibc-headers-2.5-65 glibc-headers-2.5 passed
rac1 glibc-headers-2.5-65 glibc-headers-2.5 passed
Result:Package existence check passed for"glibc-headers"
Check:Package existence for"gcc-c++(x86_64)"
NodeNameAvailableRequiredStatus
----------------------------------------------------------------------
rac2 gcc-c++(x86_64)-4.1.2-51.el5 gcc-c++(x86_64)-4.1.2 passed
rac1 gcc-c++(x86_64)-4.1.2-51.el5 gcc-c++(x86_64)-4.1.2 passed
Result:Package existence check passed for"gcc-c++(x86_64)"
Check:Package existence for"libaio-devel(x86_64)"
NodeNameAvailableRequiredStatus
----------------------------------------------------------------------
rac2 libaio-devel(x86_64)-0.3.106-5 libaio-devel(x86_64)-0.3.106 passed
rac1 libaio-devel(x86_64)-0.3.106-5 libaio-devel(x86_64)-0.3.106 passed
Result:Package existence check passed for"libaio-devel(x86_64)"
Check:Package existence for"libgcc(x86_64)"
NodeNameAvailableRequiredStatus
----------------------------------------------------------------------
rac2 libgcc(x86_64)-4.1.2-51.el5 libgcc(x86_64)-4.1.2 passed
rac1 libgcc(x86_64)-4.1.2-51.el5 libgcc(x86_64)-4.1.2 passed
Result:Package existence check passed for"libgcc(x86_64)"
Check:Package existence for"libstdc++(x86_64)"
NodeNameAvailableRequiredStatus
----------------------------------------------------------------------
rac2 libstdc++(x86_64)-4.1.2-51.el5 libstdc++(x86_64)-4.1.2 passed
rac1 libstdc++(x86_64)-4.1.2-51.el5 libstdc++(x86_64)-4.1.2 passed
Result:Package existence check passed for"libstdc++(x86_64)"
Check:Package existence for"libstdc++-devel(x86_64)"
NodeNameAvailableRequiredStatus
----------------------------------------------------------------------
rac2 libstdc++-devel(x86_64)-4.1.2-51.el5 libstdc++-devel(x86_64)-4.1.2 passed
rac1 libstdc++-devel(x86_64)-4.1.2-51.el5 libstdc++-devel(x86_64)-4.1.2 passed
Result:Package existence check passed for"libstdc++-devel(x86_64)"
Check:Package existence for"sysstat"
NodeNameAvailableRequiredStatus
----------------------------------------------------------------------
rac2 sysstat-7.0.2-11.el5 sysstat-7.0.2 passed
rac1 sysstat-7.0.2-11.el5 sysstat-7.0.2 passed
Result:Package existence check passed for"sysstat"
Check:Package existence for"ksh"
NodeNameAvailableRequiredStatus
----------------------------------------------------------------------
rac2 ksh-20100202-1.el5_6.6 ksh-20060214 passed
rac1 ksh-20100202-1.el5_6.6 ksh-20060214 passed
Result:Package existence check passed for"ksh"
Checkingfor multiple users with UID value 0
Result:Checkfor multiple users with UID value 0 passed
Check:Current group ID
Result:Current group ID check passed
Starting check for consistency of primary group of root user
NodeNameStatus
------------------------------------------------------------
rac2 passed
rac1 passed
Checkfor consistency of root user's primary group passed
Check:Package existence for"cvuqdisk"
NodeNameAvailableRequiredStatus
----------------------------------------------------------------------
rac2 cvuqdisk-1.0.9-1 cvuqdisk-1.0.9-1 passed
rac1 cvuqdisk-1.0.9-1 cvuqdisk-1.0.9-1 passed
Result:Package existence check passed for"cvuqdisk"
StartingClock synchronization checks using NetworkTimeProtocol(NTP)...
NTP Configuration file check started...
The NTP configuration file "/etc/ntp.conf" is available on all nodes
NTP Configuration file check passed
No NTP Daemons or Services were found to be running
PRVF-5507: NTP daemon or service is not running on any node but NTP configuration file exists on the following node(s):
rac2,rac1
Result:Clock synchronization check using NetworkTimeProtocol(NTP) failed
CheckingCore file name pattern consistency...
Core file name pattern consistency check passed.
Checking to make sure user "oracle" is not in "root" group
NodeNameStatusComment
------------------------------------------------------------
rac2 passed does not exist
rac1 passed does not exist
Result:User"oracle" is not part of "root" group.Check passed
Checkdefault user file creation mask
NodeNameAvailableRequiredComment
----------------------------------------------------------------------
rac2 00220022 passed
rac1 00220022 passed
Result:Default user file creation mask check passed
Checking consistency of file "/etc/resolv.conf" across nodes
Checking the file "/etc/resolv.conf" to make sure only one of domain and search entries is defined
File"/etc/resolv.conf" does not have both domain and search entries defined
Checkingif domain entry in file "/etc/resolv.conf" is consistent across the nodes...
domain entry in file "/etc/resolv.conf" is consistent across nodes
Checkingif search entry in file "/etc/resolv.conf" is consistent across the nodes...
search entry in file "/etc/resolv.conf" is consistent across nodes
Checking DNS response time for an unreachable node
NodeNameStatus
------------------------------------------------------------
rac2 failed
rac1 failed
PRVF-5636:The DNS response time for an unreachable node exceeded "15000" ms on following nodes: rac2,rac1
File"/etc/resolv.conf" is not consistent across nodes
UDev attributes check for OCR locations started...
Checking udev settings for device "/dev/raw/raw1"
DeviceOwnerGroupPermissionsResult
--------------------------------------------------------------------
raw1 root oinstall 0640 passed
raw1 root oinstall 0640 passed
Result:UDev attributes check passed for OCR locations
UDev attributes check forVotingDisk locations started...
Checking udev settings for device "/dev/raw/raw2"
DeviceOwnerGroupPermissionsResult
--------------------------------------------------------------------
raw2 oracle oinstall 0640 passed
raw2 oracle oinstall 0640 passed
Result:UDev attributes check passed forVotingDisk locations
Check:Time zone consistency
Result:Time zone consistency check passed
Checking VIP configuration.
Checking VIP Subnet configuration.
Checkfor VIP Subnet configuration passed.
Checking VIP reachability
Checkfor VIP reachability passed.
CheckingOracleClusterVotingDisk configuration...
ERROR:
PRVF-5449:Check of VotingDisk location "/dev/raw/raw2(/dev/raw/raw2)" failed on the following nodes:
rac2
rac2:GetFileInfo command failed.
PRVF-5431:OracleClusterVotingDisk configuration check failed
Clusterware version consistency passed
Pre-check for cluster services setup was unsuccessful on all the nodes.
The issue will cause a node reboot, however, rootupgrade.sh will succeed and upgrade will finish successfully.
To avoid the node eviction, patch 14617909 should be applied to 10.2.0.5 CRS home prior to running rootupgrade.sh
[oracle@rac1 grid]$ grid
[oracle@rac1 grid]$ env |grep ORACLE
ORACLE_SID=+ASM1
ORACLE_BASE=/u01/app
ORACLE_HOME=/u01/11.2.0/grid
这里选择第二项:Upgrade Oracle Grid Infrastucture or Oracle Automatic Storage Management
[root@rac1 ~]#/u01/11.2.0/grid/rootupgrade.sh
Performing root user operation forOracle11g
The following environment variables are set as:
ORACLE_OWNER= oracle
ORACLE_HOME=/u01/11.2.0/grid
Enter the full pathname of the local bin directory:[/usr/local/bin]:
The file "dbhome" already exists in /usr/local/bin.Overwrite it?(y/n)
[n]: y
Copying dbhome to /usr/local/bin ...
The file "oraenv" already exists in /usr/local/bin.Overwrite it?(y/n)
[n]: y
Copying oraenv to /usr/local/bin ...
The file "coraenv" already exists in /usr/local/bin.Overwrite it?(y/n)
[n]: y
Copying coraenv to /usr/local/bin ...
Entries will be added to the /etc/oratab file as needed by
DatabaseConfigurationAssistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.
Using configuration parameter file:/u01/11.2.0/grid/crs/install/crsconfig_params
Creating trace directory
User ignored Prerequisites during installation
InstallingTraceFileAnalyzer
OLR initialization - successful
root wallet
root wallet cert
root cert export
peer wallet
profile reader wallet
pa wallet
peer wallet keys
pa wallet keys
peer cert request
pa cert request
peer cert
pa cert
peer root cert TP
profile reader root cert TP
pa root cert TP
peer pa cert TP
pa peer cert TP
profile reader pa cert TP
profile reader peer cert TP
peer user cert
pa user cert
ReplacingClusterware entries in inittab
clscfg: EXISTING configuration version 3 detected.
clscfg: version 3 is 10GRelease2.
Successfully accumulated necessary OCR keys.
Creating OCR keys for user 'root', privgrp 'root'..
Operation successful.
ConfigureOracleGridInfrastructurefor a Cluster... succeeded
[root@rac2 ~]#/u01/11.2.0/grid/rootupgrade.sh
Performing root user operation forOracle11g
The following environment variables are set as:
ORACLE_OWNER= oracle
ORACLE_HOME=/u01/11.2.0/grid
Enter the full pathname of the local bin directory:[/usr/local/bin]:
The file "dbhome" already exists in /usr/local/bin.Overwrite it?(y/n)
[n]: y
Copying dbhome to /usr/local/bin ...
The file "oraenv" already exists in /usr/local/bin.Overwrite it?(y/n)
[n]: y
Copying oraenv to /usr/local/bin ...
The file "coraenv" already exists in /usr/local/bin.Overwrite it?(y/n)
[n]: y
Copying coraenv to /usr/local/bin ...
Entries will be added to the /etc/oratab file as needed by
DatabaseConfigurationAssistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.
Using configuration parameter file:/u01/11.2.0/grid/crs/install/crsconfig_params
Creating trace directory
User ignored Prerequisites during installation
InstallingTraceFileAnalyzer
OLR initialization - successful
ReplacingClusterware entries in inittab
clscfg: EXISTING configuration version 5 detected.
clscfg: version 5 is 11gRelease2.
Successfully accumulated necessary OCR keys.
Creating OCR keys for user 'root', privgrp 'root'..
Operation successful.
Start upgrade invoked..
Started to upgrade the OracleClusterware.This operation may take a few minutes.
Started to upgrade the OCR.
Started to upgrade the CSS.
Started to upgrade the CRS.
The CRS was successfully upgraded.
Successfully upgraded the OracleClusterware.
OracleClusterware operating version was successfully set to 11.2.0.4.0
ConfigureOracleGridInfrastructurefor a Cluster... succeeded
INFO:Liveness check failed for"ntpd"
INFO:Check failed on nodes:
INFO: rac2,rac1
INFO: PRVF-5494:The NTP Daemon or Service was not alive on all nodes
INFO: PRVF-5415:Check to see if NTP daemon or service is running failed
INFO:Clock synchronization check using NetworkTimeProtocol(NTP) failed
INFO: PRVF-9652:ClusterTimeSynchronizationServices check failed
INFO:Checking VIP configuration.
INFO:Checking VIP Subnet configuration.
INFO:Checkfor VIP Subnet configuration passed.
INFO:Checking VIP reachability
INFO:Checkfor VIP reachability passed.
INFO:Post-check for cluster services setup was unsuccessful on all the nodes.
[oracle@rac1 grid]$ ocrcheck
Status of OracleClusterRegistry is as follows :
Version:3
Total space (kbytes):1039908
Used space (kbytes):6228
Available space (kbytes):1033680
ID :1371096888
Device/FileName:/dev/raw/raw1
Device/File integrity check succeeded
Device/File not configured
Device/File not configured
Device/File not configured
Device/File not configured
Cluster registry integrity check succeeded
Logical corruption check bypassed due to non-privileged user
[oracle@rac1 grid]$ env |grep PATH
PATH=/u01/11.2.0/grid/bin:/u01/app/oracle/product/10.2.0/crs/bin:/u01/app/oracle/product/10.2.0/db_1/bin:/u01/app/oracle/product/10.2.0/crs/bin:/usr/kerberos/bin:/usr/local/bin:/bin:/usr/bin:/home/oracle/bin:/home/oracle/bin
[oracle@rac1 grid]$ crsctl query css votedisk
## STATE FileUniversalIdFileNameDisk group
------------------------------------------
1. ONLINE 32d0508888cbcf0abf885eeeeeec5ae7(/dev/raw/raw2)[]
Located1 voting disk(s).
[oracle@rac1 grid]$ crsctl query crs softwareversion
OracleClusterware version on node [rac1] is [11.2.0.4.0]
[oracle@rac1 grid]$ crsctl stat res -t
--------------------------------------------------------------------------------
NAME TARGET STATE SERVER STATE_DETAILS
--------------------------------------------------------------------------------
LocalResources
--------------------------------------------------------------------------------
ora.DATA.dg
ONLINE ONLINE rac1
ONLINE ONLINE rac2
ora.LISTENER.lsnr
ONLINE ONLINE rac1
ONLINE ONLINE rac2
ora.asm
ONLINE ONLINE rac1 Started
ONLINE ONLINE rac2 Started
ora.gsd
OFFLINE OFFLINE rac1
OFFLINE OFFLINE rac2
ora.net1.network
ONLINE ONLINE rac1
ONLINE ONLINE rac2
ora.ons
ONLINE ONLINE rac1
ONLINE ONLINE rac2
ora.registry.acfs
ONLINE ONLINE rac1
ONLINE ONLINE rac2
--------------------------------------------------------------------------------
ClusterResources
--------------------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
1 ONLINE ONLINE rac1
ora.cvu
1 ONLINE ONLINE rac2
ora.oc4j
1 ONLINE ONLINE rac2
ora.rac.db
1 ONLINE ONLINE rac2
ora.rac.rac1.inst
1 ONLINE ONLINE rac1
ora.rac.rac2.inst
1 ONLINE ONLINE rac2
ora.rac1.vip
1 ONLINE ONLINE rac1
ora.rac2.vip
1 ONLINE ONLINE rac2
ora.scan1.vip
1 ONLINE ONLINE rac1
[root@rac1 ~]# crs_stat -t
NameTypeTargetStateHost
------------------------------------------------------------
ora.DATA.dg ora....up.type ONLINE ONLINE rac1
ora....ER.lsnr ora....er.type ONLINE ONLINE rac1
ora....N1.lsnr ora....er.type ONLINE ONLINE rac1
ora.asm ora.asm.type ONLINE ONLINE rac1
ora.cvu ora.cvu.type ONLINE ONLINE rac2
ora.gsd ora.gsd.type OFFLINE OFFLINE
ora....network ora....rk.type ONLINE ONLINE rac1
ora.oc4j ora.oc4j.type ONLINE ONLINE rac2
ora.ons ora.ons.type ONLINE ONLINE rac1
ora.rac.db application ONLINE ONLINE rac2
ora....c1.inst application ONLINE ONLINE rac1
ora....c2.inst application ONLINE ONLINE rac2
ora.rac1.vip ora....t1.type ONLINE ONLINE rac1
ora.rac2.vip ora....t1.type ONLINE ONLINE rac2
ora....ry.acfs ora....fs.type ONLINE ONLINE rac1
ora.scan1.vip ora....ip.type ONLINE ONLINE rac1
注意:在刚刚升级完后,10g的环境变量请不要先清除掉,因为这个时候11g的CRS集群件已经默认把Database注册到集群当中了,但是11g的crs软件的srvctl是不能将数据库停止掉的
2.迁移ocr和vote
升级完成grid之后,原来的ocr和vote还是放在裸设备中,而11g是放在asm中的,我们创建一个新的磁盘组ocr来替换原来的ocr和vote.
使用asmca来创建新的ocr磁盘组
[oracle@rac1 grid]$ /u01/11.2.0/grid/bin/asmca
[root@rac1 ~]# cd /u01/11.2.0/grid/bin
[root@rac1 bin]#./ocrconfig -add +ocrvote
[root@rac1 bin]#./ocrconfig -delete/dev/raw/raw1
[root@rac1 bin]#./ocrcheck
Status of OracleClusterRegistry is as follows :
Version:3
Total space (kbytes):1039908
Used space (kbytes):6252
Available space (kbytes):1033656
ID :1371096888
Device/FileName:+ocrvote
Device/File integrity check succeeded
Device/File not configured
Device/File not configured
Device/File not configured
Device/File not configured
Cluster registry integrity check succeeded
Logical corruption check succeeded
[oracle@rac1 ~]$ crsctl replace votedisk +ocrvote
CRS-4256:Updating the profile
Successful addition of voting disk 63b58556b1f24f0cbf17c5e690264da3.
Successful deletion of voting disk 32d0508888cbcf0abf885eeeeeec5ae7.
Successfully replaced voting disk group with+ocrvote.
CRS-4256:Updating the profile
CRS-4266:Voting file(s) successfully replaced
[oracle@rac1 ~]$ crsctl query css votedisk
## STATE FileUniversalIdFileNameDisk group
------------------------------------------
1. ONLINE 63b58556b1f24f0cbf17c5e690264da3(/dev/raw/raw5)[OCRVOTE]
Located1 voting disk(s).
3.升级database软件
[oracle@rac1 database]$ env |grep ORACLE
ORACLE_SID=rac1
ORACLE_BASE=/u01/app
ORACLE_HOME=/u01/app/oracle/product/11.2.0/db_1
[oracle@rac1 database]$ ./runInstaller
StartingOracleUniversalInstaller...
CheckingTemp space: must be greater than 120 MB.Actual5896 MB Passed
Checking swap space: must be greater than 150 MB.Actual2527 MB Passed
Checking monitor: must be configured to display at least 256 colors.Actual16777216Passed
[oracle@rac1 ~]$ srvctl -h|grep relocate
Usage: srvctl relocate database -d <db_unique_name>{[-n <target>][-w <timeout>]|-a [-r]}[-v]
Usage: srvctl relocate service -d <db_unique_name>-s <service_name>{-i <old_inst_name>-t <new_inst_name>|-c <current_node>-n <target_node>}[-f]
Usage: srvctl relocate vip -i <vip_name>[-n <node_name>][-f][-v]
Usage: srvctl relocate scan -i <ordinal_number>[-n <node_name>]
Usage: srvctl relocate scan_listener -i <ordinal_number>[-n <node_name>]
Usage: srvctl relocate server -n "<server_list>"-g <pool_name>[-f]
Usage: srvctl relocate oc4j [-n <node_name>][-v]
Usage: srvctl relocate gns [-n <node_name>][-v]
Usage: srvctl relocate cvu [-n <node_name>]
[root@rac1 oracle]#/u01/app/oracle/product/11.2.0/db_1/root.sh
Performing root user operation forOracle11g
The following environment variables are set as:
ORACLE_OWNER= oracle
ORACLE_HOME=/u01/app/oracle/product/11.2.0/db_1
Enter the full pathname of the local bin directory:[/usr/local/bin]:
The contents of "dbhome" have not changed.No need to overwrite.
The contents of "oraenv" have not changed.No need to overwrite.
The contents of "coraenv" have not changed.No need to overwrite.
Entries will be added to the /etc/oratab file as needed by
DatabaseConfigurationAssistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.
Finished product-specific root actions.
[root@rac2 ~]#/u01/app/oracle/product/11.2.0/db_1/root.sh
Performing root user operation forOracle11g
The following environment variables are set as:
ORACLE_OWNER= oracle
ORACLE_HOME=/u01/app/oracle/product/11.2.0/db_1
Enter the full pathname of the local bin directory:[/usr/local/bin]:
The contents of "dbhome" have not changed.No need to overwrite.
The contents of "oraenv" have not changed.No need to overwrite.
The contents of "coraenv" have not changed.No need to overwrite.
Entries will be added to the /etc/oratab file as needed by
DatabaseConfigurationAssistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.
Finished product-specific root actions.
4.升级数据库数据字典
[oracle@rac1 database]$ crsctl|grep query
crsctl query css votedisk - lists the voting disks used by CSS
crsctl query crs softwareversion [<nodename>]- lists the version of CRS software installed
crsctl query crs activeversion - lists the CRS software operating version
[oracle@rac1 database]$ crsctl query crs softwareversion
CRS software version on node [rac1] is [11.2.0.4.0]
[oracle@rac1 database]$ crsctl query crs activeversion
CRS active version on the cluster is [11.2.0.4.0]
[oracle@rac1 database]$
[oracle@rac2 ~]$ sqlplus / as sysdba
SQL*Plus:Release11.2.0.4.0Production on WedNov2301:41:352016
Copyright(c)1982,2013,Oracle.All rights reserved.
Connected to:
OracleDatabase11gEnterpriseEditionRelease11.2.0.4.0-64bitProduction
With the Partitioning,RealApplicationClusters,AutomaticStorageManagement, OLAP,
DataMining and RealApplicationTesting options
SQL> select status from v$instance;
STATUS
------------
OPEN
SQL> select * from v$version;
BANNER
--------------------------------------------------------------------------------
OracleDatabase11gEnterpriseEditionRelease11.2.0.4.0-64bitProduction
PL/SQL Release11.2.0.4.0-Production
CORE 11.2.0.4.0Production
TNS forLinux:Version11.2.0.4.0-Production
NLSRTL Version11.2.0.4.0-Production
[oracle@rac2 ~]$ crsctl stat res -t
--------------------------------------------------------------------------------
NAME TARGET STATE SERVER STATE_DETAILS
--------------------------------------------------------------------------------
LocalResources
--------------------------------------------------------------------------------
ora.DATA.dg
ONLINE ONLINE rac1
ONLINE ONLINE rac2
ora.LISTENER.lsnr
ONLINE ONLINE rac1
ONLINE ONLINE rac2
ora.OCRVOTE.dg
ONLINE ONLINE rac1
ONLINE ONLINE rac2
ora.asm
ONLINE ONLINE rac1 Started
ONLINE ONLINE rac2 Started
ora.gsd
OFFLINE OFFLINE rac1
OFFLINE OFFLINE rac2
ora.net1.network
ONLINE ONLINE rac1
ONLINE ONLINE rac2
ora.ons
ONLINE ONLINE rac1
ONLINE ONLINE rac2
ora.registry.acfs
ONLINE ONLINE rac1
ONLINE ONLINE rac2
--------------------------------------------------------------------------------
ClusterResources
--------------------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
1 ONLINE ONLINE rac1
ora.cvu
1 ONLINE ONLINE rac1
ora.oc4j
1 ONLINE ONLINE rac1
ora.rac.db
1 ONLINE ONLINE rac1 Open
2 ONLINE ONLINE rac2 Open
ora.rac1.vip
1 ONLINE ONLINE rac1
ora.rac2.vip
1 ONLINE ONLINE rac2
ora.scan1.vip
1 ONLINE ONLINE rac1
[oracle@rac2 ~]$
1* select COMP_NAME,VERSION,STATUS from dba_registry
SQL>/
COMP_NAME VERSION STATUS
---------------------------------------------------------------------------------------
OracleWorkspaceManager11.2.0.4.0 VALID
OracleDatabaseCatalogViews11.2.0.4.0 VALID
OracleDatabasePackages and Types11.2.0.4.0 VALID
OracleRealApplicationClusters11.2.0.4.0 VALID
5.移除旧的10G oracle crs和rdbms home
确保升级成功后,我们可以移除旧的ORACLE_HOME
[oracle@rac1 ContentsXML]$ pwd
/u01/app/oraInventory/ContentsXML
[oracle@rac1 ContentsXML]$ cat inventory.xml
<?xml version="1.0" standalone="yes"?>
<!--Copyright(c)1999,2013,Oracle and/or its affiliates.
All rights reserved.-->
<!--Do not modify the contents of this file by hand.-->
<INVENTORY>
<VERSION_INFO>
<SAVED_WITH>11.2.0.4.0</SAVED_WITH>
<MINIMUM_VER>2.1.0.6.0</MINIMUM_VER>
</VERSION_INFO>
<HOME_LIST>
<HOME NAME="OraCrs10g_home" LOC="/u01/app/oracle/product/10.2.0/crs" TYPE="O" IDX="1">
<NODE_LIST>
<NODE NAME="rac1"/>
<NODE NAME="rac2"/>
</NODE_LIST>
</HOME>
<HOME NAME="OraDb10g_home1" LOC="/u01/app/oracle/product/10.2.0/db_1" TYPE="O" IDX="2">
<NODE_LIST>
<NODE NAME="rac1"/>
<NODE NAME="rac2"/>
</NODE_LIST>
</HOME>
<HOME NAME="Ora11g_gridinfrahome1" LOC="/u01/11.2.0/grid" TYPE="O" IDX="3" CRS="true">
<NODE_LIST>
<NODE NAME="rac1"/>
<NODE NAME="rac2"/>
</NODE_LIST>
</HOME>
<HOME NAME="OraDb11g_home1" LOC="/u01/app/oracle/product/11.2.0/db_1" TYPE="O" IDX="4">
<NODE_LIST>
<NODE NAME="rac1"/>
<NODE NAME="rac2"/>
</NODE_LIST>
</HOME>
</HOME_LIST>
<COMPOSITEHOME_LIST>
</COMPOSITEHOME_LIST>
</INVENTORY>
[oracle@rac1 bin]$ pwd
/u01/app/oracle/product/10.2.0/crs/oui/bin
[oracle@rac1 bin]$ ./runInstaller
StartingOracleUniversalInstaller...
No pre-requisite checks found in oraparam.ini, no system pre-requisite checks will be executed.
Preparing to launch OracleUniversalInstaller from /tmp/OraInstall2016-11-23_01-54-31AM.Please wait ...[oracle@rac1 bin]$ OracleUniversalInstaller,Version10.2.0.5.0Production
Copyright(C)1999,2010,Oracle.All rights reserved.
[root@rac1 u01]# cd app/oracle/product/
[root@rac1 product]# ls -l
total 8
drwxrwx---3 oracle oinstall 4096Nov2302:1010.2.0
drwxr-xr-x 3 root root 4096Nov2219:1911.2.0
[root@rac1 product]# rm -rf 10.2.0
SQL> startup
ORA-27504: IPC error creating OSD context
[oracle@rac1 lib]$ pwd
/u01/app/oracle/product/11.2.0/db_1/rdbms/lib
[oracle@rac1 lib]$ make -f ins_rdbms.mk ipc_g
rm -f /u01/app/oracle/product/11.2.0/db_1/lib/libskgxp11.so
cp /u01/app/oracle/product/11.2.0/db_1/lib//libskgxpg.so /u01/app/oracle/product/11.2.0/db_1/lib/libskgxp11.so
SQL> startup
ORACLE instance started.
TotalSystemGlobalArea622149632 bytes
FixedSize2255792 bytes
VariableSize243270736 bytes
DatabaseBuffers373293056 bytes
RedoBuffers3330048 bytes
Database mounted.
Database opened.
[oracle@rac1 lib]$ crsctl stat res -t
--------------------------------------------------------------------------------
NAME TARGET STATE SERVER STATE_DETAILS
--------------------------------------------------------------------------------
LocalResources
--------------------------------------------------------------------------------
ora.DATA.dg
ONLINE ONLINE rac1
ONLINE ONLINE rac2
ora.LISTENER.lsnr
ONLINE ONLINE rac1
ONLINE ONLINE rac2
ora.OCRVOTE.dg
ONLINE ONLINE rac1
ONLINE ONLINE rac2
ora.asm
ONLINE ONLINE rac1 Started
ONLINE ONLINE rac2 Started
ora.gsd
OFFLINE OFFLINE rac1
OFFLINE OFFLINE rac2
ora.net1.network
ONLINE ONLINE rac1
ONLINE ONLINE rac2
ora.ons
ONLINE ONLINE rac1
ONLINE ONLINE rac2
ora.registry.acfs
ONLINE ONLINE rac1
ONLINE ONLINE rac2
--------------------------------------------------------------------------------
ClusterResources
--------------------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
1 ONLINE ONLINE rac1
ora.cvu
1 ONLINE ONLINE rac1
ora.oc4j
1 ONLINE ONLINE rac1
ora.rac.db
1 ONLINE ONLINE rac1 Open
2 ONLINE ONLINE rac2 Open
ora.rac1.vip
1 ONLINE ONLINE rac1
ora.rac2.vip
1 ONLINE ONLINE rac2
ora.scan1.vip
1 ONLINE ONLINE rac1