rac 2个节点 操作系统 linux5.4 数据库:10.2.0.5 存储用的是asm
[oracle@rac1 ~]$ crs_stat -t
Name Type Target State Host
------------------------------------------------------------
ora.rac.db application OFFLINE OFFLINE
ora....c1.inst application ONLINE OFFLINE
ora....c2.inst application OFFLINE OFFLINE
ora....test.cs application OFFLINE OFFLINE
ora....ac1.srv application OFFLINE OFFLINE
ora....ac2.srv application OFFLINE OFFLINE
ora....SM1.asm application ONLINE ONLINE rac1
ora....C1.lsnr application ONLINE ONLINE rac1
ora.rac1.gsd application ONLINE ONLINE rac1
ora.rac1.ons application ONLINE ONLINE rac1
ora.rac1.vip application ONLINE ONLINE rac1
ora....SM2.asm application ONLINE ONLINE rac2
ora....C2.lsnr application ONLINE ONLINE rac2
ora.rac2.gsd application ONLINE ONLINE rac2
ora.rac2.ons application ONLINE ONLINE rac2
ora.rac2.vip application ONLINE ONLINE rac
启动数据库
[oracle@rac1 ~]$ srvctl start database -d rac
PRKP-1001 : Error starting instance rac1 on node rac1
CRS-0215: Could not start resource 'ora.rac.rac1.inst'.
PRKP-1001 : Error starting instance rac2 on node rac2
CRS-0215: Could not start resource 'ora.rac.rac2.inst'.
[oracle@rac1 ~]$ crs_stat -t
Name Type Target State Host
------------------------------------------------------------
ora.rac.db application OFFLINE OFFLINE
ora....c1.inst application ONLINE OFFLINE
ora....c2.inst application ONLINE OFFLINE
ora....test.cs application OFFLINE OFFLINE
ora....ac1.srv application OFFLINE OFFLINE
ora....ac2.srv application OFFLINE OFFLINE
ora....SM1.asm application ONLINE ONLINE rac1
ora....C1.lsnr application ONLINE ONLINE rac1
ora.rac1.gsd application ONLINE ONLINE rac1
ora.rac1.ons application ONLINE ONLINE rac1
ora.rac1.vip application ONLINE ONLINE rac1
ora....SM2.asm application ONLINE ONLINE rac2
ora....C2.lsnr application ONLINE ONLINE rac2
ora.rac2.gsd application ONLINE ONLINE rac2
ora.rac2.ons application ONLINE ONLINE rac2
ora.rac2.vip application ONLINE ONLINE rac2
数据库启动不起来,在sqlplus下启动正常
SQL> startup
ORACLE instance started.
Total System Global Area 327155712 bytes
Fixed Size 1273516 bytes
Variable Size 104857940 bytes
Database Buffers 218103808 bytes
Redo Buffers 2920448 bytes
Database mounted.
Database opened.
crsd日志
2011-06-20 23:45:29.171: [ CRSRES][2730044304]0Attempting to start `ora.rac.rac2.inst` on member `rac2`
2011-06-20 23:45:29.544: [ CRSRES][2740534160]0startRunnable: setting CLI values
2011-06-20 23:45:29.842: [ CRSRES][2696936336]0startRunnable: setting CLI values
2011-06-20 23:45:29.842: [ CRSRES][2696936336]0Attempting to start `ora.rac.test.cs` on member `rac1`
2011-06-20 23:45:30.183: [ CRSRES][2740534160]0Attempting to start `ora.rac.test.rac1.srv` on member `rac1`
2011-06-20 23:45:31.556: [ CRSRES][2686446480]0startRunnable: setting CLI values
2011-06-20 23:45:31.573: [ CRSRES][2686446480]0Attempting to start `ora.rac.db` on member `rac1`
2011-06-20 23:45:32.036: [ CRSRES][2719554448]0Attempting to start `ora.rac.test.rac2.srv` on member `rac2`
2011-06-20 23:45:40.302: [ CRSAPP][2675956624]0StartResource error for ora.rac.rac1.inst error code = 1
2011-06-20 23:45:43.471: [ CRSRES][2675956624]0Start of `ora.rac.rac1.inst` on member `rac1` failed.
2011-06-20 23:45:44.222: [ CRSRES][2644487056]0startRunnable: setting CLI values
2011-06-20 23:45:44.507: [ CRSRES][2644487056]0Attempting to start `ora.rac.rac1.inst` on member `rac1`
2011-06-20 23:45:50.113: [ CRSRES][2730044304]0Start of `ora.rac.rac2.inst` on member `rac2` failed.
2011-06-20 23:45:55.060: [ CRSAPP][2644487056]0StartResource error for ora.rac.rac1.inst error code = 1
2011-06-20 23:45:58.719: [ CRSRES][2644487056]0Start of `ora.rac.rac1.inst` on member `rac1` failed.
2011-06-20 23:45:58.774: [ CRSRES][2644487056]0rac2 : CRS-1019: Resource ora.rac1.LISTENER_RAC1.lsnr (application) cannot run on rac2
2011-06-20 23:45:59.783: [ CRSRES][2644487056]0startRunnable: setting CLI values
2011-06-20 23:45:59.840: [ CRSRES][2644487056]0Attempting to start `ora.rac.rac1.inst` on member `rac1`
2011-06-20 23:46:03.469: [ CRSAPP][2686446480]0StartResource error for ora.rac.db error code = 1
2011-06-20 23:46:04.199: [ CRSRES][2686446480]0Start of `ora.rac.db` on member `rac1` failed.
2011-06-20 23:46:05.186: [ CRSRES][2686446480]0Attempting to start `ora.rac.db` on member `rac2`
2011-06-20 23:46:05.405: [ CRSRES][2719554448]0Start of `ora.rac.test.rac2.srv` on member `rac2` failed.
2011-06-20 23:46:06.980: [ CRSRES][2654976912]0Attempting to start `ora.rac.test.rac2.srv` on member `rac2`
2011-06-20 23:46:08.470: [ CRSRES][2654976912]0Start of `ora.rac.test.rac2.srv` on member `rac2` failed.
2011-06-20 23:46:09.949: [ CRSRES][2654976912]0Attempting to start `ora.rac.test.rac2.srv` on member `rac2`
2011-06-20 23:46:14.273: [ CRSAPP][2644487056]0StartResource error for ora.rac.rac1.inst error code = 1
2011-06-20 23:46:17.276: [ CRSRES][2644487056]0Start of `ora.rac.rac1.inst` on member `rac1` failed.
2011-06-20 23:46:17.423: [ CRSRES][2644487056]0rac2 : CRS-1019: Resource ora.rac1.LISTENER_RAC1.lsnr (application) cannot run on rac2
2011-06-20 23:46:17.507: [ CRSAPP][2740534160]0StartResource error for ora.rac.test.rac1.srv error code = 1
2011-06-20 23:46:18.104: [ CRSRES][2644487056]0startRunnable: setting CLI values
2011-06-20 23:46:18.150: [ CRSRES][2740534160]0Start of `ora.rac.test.rac1.srv` on member `rac1` failed.
2011-06-20 23:46:28.250: [ CRSAPP][2644487056]0StartResource error for ora.rac.rac1.inst error code = 1
2011-06-20 23:46:31.900: [ CRSRES][2686446480]0Start of `ora.rac.db` on member `rac2` failed.
2011-06-20 23:46:36.990: [ CRSRES][2654976912]0Start of `ora.rac.test.rac2.srv` on member `rac2` failed.
2011-06-20 23:46:37.065: [ CRSRES][2654976912]0rac1 : CRS-1019: Resource ora.rac.test.rac2.srv (application) cannot run on rac1
2011-06-20 23:46:37.104: [ CRSAPP][2696936336]0StartResource error for ora.rac.test.cs error code = 1
2011-06-20 23:46:37.608: [ CRSRES][2696936336]0Start of `ora.rac.test.cs` on member `rac1` failed.
2011-06-20 23:46:37.813: [ CRSRES][2696936336]0Attempting to start `ora.rac.test.cs` on member `rac2`
2011-06-20 23:46:38.757: [ CRSRES][2654976912]0startRunnable: setting CLI values
2011-06-20 23:46:40.073: [ CRSRES][2644487056]0startRunnable: setting CLI values
2011-06-20 23:46:40.132: [ CRSRES][2644487056]0Attempting to start `ora.rac.rac1.inst` on member `rac1`
2011-06-20 23:46:49.746: [ CRSAPP][2644487056]0StartResource error for ora.rac.rac1.inst error code = 1
2011-06-20 23:46:52.272: [ CRSRES][2644487056]0Start of `ora.rac.rac1.inst` on member `rac1` failed.
2011-06-20 23:46:52.363: [ CRSRES][2644487056]0rac2 : CRS-1019: Resource ora.rac1.LISTENER_RAC1.lsnr (application) cannot run on rac2
2011-06-20 23:46:52.398: [ CRSAPP][2654976912]0StartResource error for ora.rac.test.rac1.srv error code = 1
2011-06-20 23:46:53.264: [ CRSRES][2654976912]0startRunnable: setting CLI values
2011-06-20 23:46:53.878: [ CRSAPP][2654976912]0StartResource error for ora.rac.test.rac1.srv error code = 1
2011-06-20 23:46:55.307: [ CRSRES][2696936336]0Start of `ora.rac.test.cs` on member `rac2` failed.
2011-06-21 00:06:15.570: [ CRSRES][2730044304]0startRunnable: setting CLI values
2011-06-21 00:06:16.166: [ CRSRES][2740534160]0Attempting to start `ora.rac.rac2.inst` on member `rac2`
2011-06-21 00:06:16.439: [ CRSRES][2730044304]0Attempting to start `ora.rac.rac1.inst` on member `rac1`
2011-06-21 00:06:30.516: [ CRSAPP][2730044304]0StartResource error for ora.rac.rac1.inst error code = 1
2011-06-21 00:06:33.083: [ CRSRES][2730044304]0Start of `ora.rac.rac1.inst` on member `rac1` failed.
2011-06-21 00:06:37.306: [ CRSRES][2740534160]0Start of `ora.rac.rac2.inst` on member `rac2` failed.
2011-06-21 00:13:28.568: [ CRSRES][2719554448]0startRunnable: setting CLI values
2011-06-21 00:13:29.279: [ CRSRES][2719554448]0Attempting to start `ora.rac.rac1.inst` on member `rac1`
2011-06-21 00:13:29.350: [ CRSRES][2730044304]0Attempting to start `ora.rac.rac2.inst` on member `rac2`
2011-06-21 00:13:34.420: [ CRSRES][2719554448]0Start of `ora.rac.rac1.inst` on member `rac1` succeeded.
2011-06-21 00:13:34.982: [ CRSRES][2719554448]0Attempting to start `ora.rac.db` on member `rac2`
2011-06-21 00:13:35.397: [ CRSRES][2719554448]0Start of `ora.rac.db` on member `rac2` succeeded.
2011-06-21 00:13:39.216: [ CRSRES][2719554448]0startRunnable: setting CLI values
2011-06-21 00:13:39.587: [ CRSRES][2719554448]0Attempting to start `ora.rac.test.rac1.srv` on member `rac1`
2011-06-21 00:13:40.639: [ CRSRES][2719554448]0Start of `ora.rac.test.rac1.srv` on member `rac1` succeeded.
2011-06-21 00:13:41.181: [ CRSRES][2686446480]0startRunnable: setting CLI values
2011-06-21 00:13:41.398: [ CRSRES][2686446480]0Attempting to start `ora.rac.test.cs` on member `rac1`
2011-06-21 00:13:41.782: [ CRSRES][2686446480]0Start of `ora.rac.test.cs` on member `rac1` succeeded.
2011-06-21 00:13:43.746: [ CRSRES][2730044304]0Start of `ora.rac.rac2.inst` on member `rac2` failed.
2011-06-21 00:14:37.969: [ CRSRES][2740534160]0ora.rac.rac1.inst target set to OFFLINE before stop action
2011-06-21 00:14:37.970: [ CRSRES][2740534160]0StopResource: setting CLI values
2011-06-21 00:14:38.208: [ CRSRES][2740534160]0Attempting to stop `ora.rac.rac1.inst` on member `rac1`
2011-06-21 00:14:38.548: [ CRSRES][2730044304]0In stateChanged, ora.rac.test.rac1.srv target is ONLINE
2011-06-21 00:14:38.549: [ CRSRES][2730044304]0ora.rac.test.rac1.srv on rac1 went OFFLINE unexpectedly
2011-06-21 00:14:38.549: [ CRSRES][2730044304]0StopResource: setting CLI values
2011-06-21 00:14:39.052: [ CRSRES][2730044304]0Attempting to stop `ora.rac.test.rac1.srv` on member `rac1`
2011-06-21 00:14:39.728: [ CRSRES][2730044304]0Stop of `ora.rac.test.rac1.srv` on member `rac1` succeeded.
2011-06-21 00:14:39.730: [ CRSRES][2730044304]0ora.rac.test.rac1.srv RESTART_COUNT=0 RESTART_ATTEMPTS=0
2011-06-21 00:14:39.763: [ CRSRES][2730044304]0ora.rac.test.rac1.srv failed on rac1 relocating.
2011-06-21 00:14:39.907: [ CRSRES][2730044304]0Cannot relocate ora.rac.test.rac1.srvStopping dependents
2011-06-21 00:14:39.935: [ CRSRES][2730044304]0StopResource: setting CLI values
2011-06-21 00:14:55.667: [ CRSAPP][2730044304]0CheckResource error for ora.rac.test.cs error code = 1
2011-06-21 00:14:55.679: [ CRSRES][2730044304]0In stateChanged, ora.rac.test.cs target is ONLINE
2011-06-21 00:14:55.726: [ CRSRES][2730044304]0ora.rac.test.cs on rac1 went OFFLINE unexpectedly
2011-06-21 00:14:55.727: [ CRSRES][2730044304]0StopResource: setting CLI values
2011-06-21 00:14:56.123: [ CRSRES][2730044304]0Attempting to stop `ora.rac.test.cs` on member `rac1`
2011-06-21 00:14:56.404: [ CRSRES][2730044304]0Stop of `ora.rac.test.cs` on member `rac1` succeeded.
2011-06-21 00:14:56.410: [ CRSRES][2730044304]0ora.rac.test.cs RESTART_COUNT=0 RESTART_ATTEMPTS=0
2011-06-21 00:14:56.459: [ CRSRES][2730044304]0ora.rac.test.cs exceeded it's failure threshold. Stopping it and its dependents!
2011-06-21 00:14:56.539: [ CRSRES][2730044304]0ora.rac.test.cs target set to OFFLINE before stop action
2011-06-21 00:14:56.539: [ CRSRES][2730044304]0StopResource: setting CLI values
2011-06-21 00:14:56.654: [ CRSRES][2730044304]0Target set to OFFLINE for `ora.rac.test.cs`
2011-06-21 00:15:14.301: [ CRSRES][2719554448]0ora.rac.test.rac1.srv target set to OFFLINE before stop action
2011-06-21 00:15:14.302: [ CRSRES][2719554448]0StopResource: setting CLI values
2011-06-21 00:15:14.898: [ CRSRES][2719554448]0Target set to OFFLINE for `ora.rac.test.rac1.srv`
2011-06-21 00:15:15.260: [ CRSRES][2719554448]0ora.rac.test.rac2.srv target set to OFFLINE before stop action
2011-06-21 00:15:15.298: [ CRSRES][2719554448]0StopResource: setting CLI values
2011-06-21 00:15:15.511: [ CRSRES][2719554448]0Target set to OFFLINE for `ora.rac.test.rac2.srv`
2011-06-21 00:15:15.792: [ CRSRES][2719554448]0ora.rac.db target set to OFFLINE before stop action
2011-06-21 00:15:15.792: [ CRSRES][2719554448]0StopResource: setting CLI values
2011-06-21 00:15:15.854: [ CRSRES][2719554448]0Attempting to stop `ora.rac.db` on member `rac2`
2011-06-21 00:15:16.116: [ CRSRES][2719554448]0Stop of `ora.rac.db` on member `rac2` succeeded.
2011-06-21 00:15:16.611: [ CRSRES][2740534160]0Stop of `ora.rac.rac1.inst` on member `rac1` succeeded.
2011-06-21 00:17:39.168: [ CRSRES][2730044304]0startRunnable: setting CLI values
2011-06-21 00:17:39.532: [ CRSRES][2719554448]0Attempting to start `ora.rac.rac2.inst` on member `rac2`
2011-06-21 00:17:39.705: [ CRSRES][2730044304]0Attempting to start `ora.rac.rac1.inst` on member `rac1`
2011-06-21 00:17:44.805: [ CRSRES][2719554448]0Start of `ora.rac.rac2.inst` on member `rac2` succeeded.
2011-06-21 00:17:56.256: [ CRSRES][2740534160]0startRunnable: setting CLI values
2011-06-21 00:17:56.788: [ CRSAPP][2730044304]0StartResource error for ora.rac.rac1.inst error code = 1
2011-06-21 00:17:59.919: [ CRSRES][2730044304]0Start of `ora.rac.rac1.inst` on member `rac1` failed.
2011-06-21 00:23:34.895: [ CRSRES][2686446480]0ora.rac.db target set to OFFLINE before stop action
2011-06-21 00:23:34.896: [ CRSRES][2686446480]0StopResource: setting CLI values
2011-06-21 00:24:51.015: [ CRSRES][2686446480]0startRunnable: setting CLI values
2011-06-21 00:24:51.747: [ CRSRES][2686446480]0Attempting to start `ora.rac.rac1.inst` on member `rac1`
2011-06-21 00:24:52.234: [ CRSRES][2719554448]0Attempting to start `ora.rac.rac2.inst` on member `rac2`
2011-06-21 00:24:55.934: [ CRSRES][2686446480]0Start of `ora.rac.rac1.inst` on member `rac1` succeeded.
2011-06-21 00:24:56.636: [ CRSRES][2686446480]0Attempting to start `ora.rac.db` on member `rac2`
2011-06-21 00:24:56.984: [ CRSRES][2686446480]0Start of `ora.rac.db` on member `rac2` succeeded.
2011-06-21 00:25:03.987: [ CRSRES][2719554448]0Start of `ora.rac.rac2.inst` on member `rac2` failed.
2011-06-21 00:32:05.979: [ CRSRES][2719554448]0Attempting to start `ora.rac.rac2.inst` on member `rac2`
2011-06-21 00:32:15.086: [ COMMCRS][2719554448]clscsendx: (0xa702c40) Physical connection (0xa6cdd40) not active
2011-06-21 00:32:15.086: [ CRSCOMM][2719554448]0Sending message size 124clscsend ret 11
2011-06-21 00:32:15.109: [ CRSEVT][2719554448]0Error sending orders to command IOException : CRS sending message error
(File: caa_Message.cpp, line: 660
2011-06-21 00:32:15.109: [ CRSRES][2719554448]0Start of `ora.rac.rac2.inst` on member `rac2` failed.
2011-06-21 00:32:15.139: [ COMMCRS][2740534160]clscsendx: (0xa702c40) Connection not active
2011-06-21 00:32:15.139: [ CRSCOMM][2740534160]0CLSC connection invalid, possible remote node failure, send failed
2011-06-21 00:32:15.191: [ CRSEVT][2740534160]0Error writing response: command=UI_START, response=UI_DATA
2011-06-21 00:32:15.191: [ CRSEVT][2740534160]0IOException : CRS sending message error
(File: caa_Message.cpp, line: 656
2011-06-21 00:35:19.860: [ CRSRES][2740534160]0ora.rac.rac1.inst target set to OFFLINE before stop action
2011-06-21 00:35:19.860: [ CRSRES][2740534160]0StopResource: setting CLI values
2011-06-21 00:35:20.149: [ CRSRES][2740534160]0Attempting to stop `ora.rac.rac1.inst` on member `rac1`
2011-06-21 00:35:58.211: [ CRSRES][2696936336]0ora.rac.db target set to OFFLINE before stop action
2011-06-21 00:35:58.212: [ CRSRES][2696936336]0StopResource: setting CLI values
2011-06-21 00:35:58.420: [ CRSRES][2696936336]0Attempting to stop `ora.rac.db` on member `rac2`
2011-06-21 00:35:58.618: [ CRSRES][2696936336]0Stop of `ora.rac.db` on member `rac2` succeeded.
2011-06-21 00:35:59.266: [ CRSRES][2740534160]0Stop of `ora.rac.rac1.inst` on member `rac1` succeeded.
2011-06-21 00:36:55.423: [ CRSRES][2740534160]0startRunnable: setting CLI values
2011-06-21 00:36:55.829: [ CRSRES][2740534160]0Attempting to start `ora.rac.rac1.inst` on member `rac1`
2011-06-21 00:36:56.091: [ CRSRES][2696936336]0Attempting to start `ora.rac.rac2.inst` on member `rac2`
2011-06-21 00:37:14.610: [ CRSRES][2696936336]0Start of `ora.rac.rac2.inst` on member `rac2` failed.
2011-06-21 00:37:18.069: [ CRSAPP][2740534160]0StartResource error for ora.rac.rac1.inst error code = 1
2011-06-21 00:37:21.082: [ CRSRES][2740534160]0Start of `ora.rac.rac1.inst` on member `rac1` failed.
用sqlplus启动2个节点的数据库,数据库正常启动
在用srvctl启动数据库状态显示正常,重启后自动起不来
[oracle@rac1 ~]$ srvctl start database -d rac
[oracle@rac1 ~]$ crs_stat -t
Name Type Target State Host
------------------------------------------------------------
ora.rac.db application ONLINE ONLINE rac2
ora....c1.inst application ONLINE ONLINE rac1
ora....c2.inst application ONLINE ONLINE rac2
ora....test.cs application OFFLINE OFFLINE
ora....ac1.srv application OFFLINE OFFLINE
ora....ac2.srv application OFFLINE OFFLINE
ora....SM1.asm application ONLINE ONLINE rac1
ora....C1.lsnr application ONLINE ONLINE rac1
ora.rac1.gsd application ONLINE ONLINE rac1
ora.rac1.ons application ONLINE ONLINE rac1
ora.rac1.vip application ONLINE ONLINE rac1
ora....SM2.asm application ONLINE ONLINE rac2
ora....C2.lsnr application ONLINE ONLINE rac2
ora.rac2.gsd application ONLINE ONLINE rac2
ora.rac2.ons application ONLINE ONLINE rac2
ora.rac2.vip application ONLINE ONLINE rac2
[本帖最后由 ksly1227 于 2011-6-20 21:09 编辑]