--== 环境介绍
11G RAC 由于机房停电,停机了。电力恢复后发现数据库不能访问了。
--== 问题描述
使用 srvctl 启动数据库报错
[oracle@dm01db01 ~]$ srvctl start database -d genome
PRCR-1079 : Failed to start resource ora.genome.db
CRS-2674: Start of 'ora.dm01db02.vip' on 'dm01db02' failed
CRS-2674: Start of 'ora.dm01db01.vip' on 'dm01db01' failed
CRS-5017: The resource action "ora.genome.db start" encountered the following error:
ORA-00119: invalid specification for system parameter REMOTE_LISTENER
ORA-00132: syntax error or unresolved network name 'dm01-scan:1521'
CRS-2674: Start of 'ora.genome.db' on 'dm01db02' failed
CRS-2632: There are no more servers to try to place resource 'ora.genome.db' on that would satisfy its placement policy
CRS-5017: The resource action "ora.genome.db start" encountered the following error:
ORA-00119: invalid specification for system parameter REMOTE_LISTENER
ORA-00132: syntax error or unresolved network name 'dm01-scan:1521'
CRS-2674: Start of 'ora.genome.db' on 'dm01db01' failed
--== 问题分析
提示 scan,REMOTE_LISTENER 有问题,通过 crsctl 查看 所有的资源情况如下;
[oracle@dm01db02 ~]$ crsctl status res -t
--------------------------------------------------------------------------------
NAME TARGET STATE SERVER STATE_DETAILS
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.DATA_DM01.dg
ONLINE ONLINE dm01db01
ONLINE ONLINE dm01db02
ora.DBFS_DG.dg
ONLINE ONLINE dm01db01
ONLINE ONLINE dm01db02
ora.LISTENER.lsnr
ONLINE OFFLINE dm01db01
ONLINE OFFLINE dm01db02
ora.RECO_DM01.dg
ONLINE ONLINE dm01db01
ONLINE ONLINE dm01db02
ora.asm
ONLINE ONLINE dm01db01
ONLINE ONLINE dm01db02
ora.gsd
OFFLINE OFFLINE dm01db01
OFFLINE OFFLINE dm01db02
ora.net1.network
ONLINE ONLINE dm01db01
ONLINE ONLINE dm01db02
ora.ons
ONLINE ONLINE dm01db01
ONLINE ONLINE dm01db02
ora.registry.acfs
ONLINE ONLINE dm01db01
ONLINE ONLINE dm01db02
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
1 ONLINE ONLINE dm01db01
ora.LISTENER_SCAN2.lsnr
1 ONLINE ONLINE dm01db02
ora.LISTENER_SCAN3.lsnr
1 ONLINE ONLINE dm01db02
ora.cvu
1 ONLINE ONLINE dm01db01
ora.dm01db01.vip
1 ONLINE OFFLINE <<< vip 没有启动
ora.dm01db02.vip
1 ONLINE OFFLINE <<< vip 没有启动
ora.genome.db
1 ONLINE OFFLINE Instance Shutdown,S
TARTING
2 ONLINE OFFLINE Instance Shutdown,S
TARTING
ora.oc4j
1 ONLINE ONLINE dm01db02
ora.scan1.vip
1 ONLINE ONLINE dm01db01
ora.scan2.vip
1 ONLINE ONLINE dm01db02
ora.scan3.vip
1 ONLINE ONLINE dm01db02
[oracle@dm01db02 ~]$
<<< 尝试手工 启动 vip
[oracle@dm01db01 ~]$ srvctl start vip -n dm01db01
PRCR-1079 : Failed to start resource ora.dm01db01.vip
CRS-2674: Start of 'ora.dm01db01.vip' on 'dm01db01' failed
CRS-2674: Start of 'ora.dm01db01.vip' on 'dm01db02' failed
CRS-2632: There are no more servers to try to place resource 'ora.dm01db01.vip'on that would satisfy its placement policy
[oracle@dm01db01 ~]$ srvctl start vip -n dm01db02
PRCR-1079 : Failed to start resource ora.dm01db02.vip
CRS-2674: Start of 'ora.dm01db02.vip' on 'dm01db02' failed
CRS-2674: Start of 'ora.dm01db02.vip' on 'dm01db01' failed
CRS-2632: There are no more servers to try to place resource 'ora.dm01db02.vip' on that would satisfy its placement policy
<<< 确认当前的 vip 解析方式。
查看 /etc/hosts 发现没有 vip相关的条目,并且cat /etc/resolv.conf 存在 namedserver
说明是这套rac的 vip使用的是 dns解析的方式
<<< 确认当前是否 vip的 dns解析是否正常。
1. 使用 crsctl config vip -n <NODE1_NAME> 确认 vip 名称
2. 使用 nslookup 命令,无法正常解析
<<< 到此已经明确问题由 vip 无法通过 dns解析出 对于的ip,导致db 启动失败。
在 dns服务器恢复后, vip成功启动,db也随之成功启动。